-----============= acceptance-small: sanityn ============----- Mon Sep  7 18:52:25 EDT 2026
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg313-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a
skipping tests SLOW=no: 33a
=== sanityn: start setup 18:52:45 (1788821565) ===
Starting client oleg313-client.virtnet:  -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre2
Mount client oleg313-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.113@tcp:/lustre /mnt/lustre2
Started clients oleg313-client.virtnet: 
192.168.203.113@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose)
oleg313-client.virtnet: executing check_config_client /mnt/lustre
oleg313-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg313-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff9e0782cdb800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff9e0788687800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9e0782cdb800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9e0788687800.idle_timeout=debug
disable quota as required
oleg313-server: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
osd-ldiskfs.track_declares_assert=1
=== sanityn: finish setup 18:53:21 (1788821601) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172578 s, 60.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f8241]

== sanityn test 77j: check TBF-OPCode NRS policy ========= 18:53:25 (1788821605)
jobid_var=procname_uid
ost.OSS.ost_io.nrs_policies=tbf opcode
ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5
ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.341931 s, 49.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0477595 s, 22.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0673905 s, 15.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.063766 s, 16.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0721279 s, 14.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111107 s, 9.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410116 s, 25.6 MB/s1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out

1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729107 s, 144 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0646907 s, 16.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551035 s, 19.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370905 s, 28.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.093839 s, 11.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226299 s, 4.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0955526 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277098 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505237 s, 208 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.273073 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0566287 s, 18.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252846 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110208 s, 95.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115667 s, 9.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138075 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0521118 s, 20.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0840189 s, 12.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.289178 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0463636 s, 22.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302182 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0482208 s, 21.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2881 s, 3.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.31874 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.32452 s, 3.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.337937 s, 3.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.318956 s, 3.3 MB/s
removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77j.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.07013 s, 20.7 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.6076 s, 5.3 MB/s
Read runtime is 21 s, speed is 4.761904 vs. 5
cleanup_tbf /mnt/lustre/d77j.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ost_r
ost.OSS.ost_io.nrs_tbf_rule=stop ost_w
ost.OSS.ost_io.nrs_policies=fifo
PASS 77j (50s)

== sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 18:54:15 (1788821655)
ost.OSS.ost_io.nrs_policies=tbf jobid+opcode+nid+uid+gid
ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.408292 s, 41.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0637907 s, 16.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123412 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149598 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13248 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120552 s, 8.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140823 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135835 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156044 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148893 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106809 s, 9.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12665 s, 8.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237547 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2477 s, 4.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255483 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280767 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.265827 s, 3.9 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=5
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262512 s, 39.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0764558 s, 13.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0446468 s, 23.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194801 s, 53.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066225 s, 158 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0713606 s, 14.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244812 s, 42.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308768 s, 34.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588923 s, 17.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564319 s, 186 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304075 s, 34.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020732 s, 50.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909384 s, 115 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142481 s, 73.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186628 s, 56.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348394 s, 30.1 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.12386 s, 20.5 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.86638 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_w
ost.OSS.ost_io.nrs_tbf_rule=stop ext_r
ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.13@tcp}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.13@tcp}&opcode={ost_read} rate=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.364951 s, 46.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0507201 s, 20.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476467 s, 22.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.081088 s, 12.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105977 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161577 s, 6.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219245 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.324311 s, 3.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232273 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.347972 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279657 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.378194 s, 2.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.309027 s, 3.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.370975 s, 2.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.35075 s, 3.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00228212 s, 459 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133267 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00343164 s, 306 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00297216 s, 353 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107004 s, 9.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.423699 s, 2.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101181 s, 10.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0652925 s, 16.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010387 s, 101 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721057 s, 145 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104519 s, 100 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.408057 s, 2.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00546602 s, 192 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00530676 s, 198 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00368231 s, 285 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154139 s, 68.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668756 s, 157 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151944 s, 69.0 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.06939 s, 20.7 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.82804 s, 10.7 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_w
ost.OSS.ost_io.nrs_tbf_rule=stop ext_r
ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.13@tcp}&jobid={dd.500} rate=20
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.468194 s, 35.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.065132 s, 16.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0599874 s, 17.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.216319 s, 4.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219968 s, 4.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196631 s, 5.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219047 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17617 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244899 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.262458 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233603 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256999 s, 4.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215479 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239694 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.2567 s, 4.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9e0782cdb800.lock_unused_count=4
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=7
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.29274 s, 3.6 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312796 s, 3.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358762 s, 29.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00476845 s, 220 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0684443 s, 15.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0533466 s, 19.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.096676 s, 10.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.048601 s, 21.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565724 s, 18.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0049957 s, 210 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1132 s, 9.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.063596 s, 16.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0452006 s, 23.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197159 s, 53.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614568 s, 17.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120646 s, 8.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106235 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573785 s, 18.3 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 20, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.02781 s, 20.9 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.06241 s, 20.7 MB/s
Read runtime is 6 s, speed is 16.666666 vs. 20
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext
ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.370882 s, 45.2 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0926577 s, 11.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0907973 s, 11.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0825503 s, 12.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230657 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.24613 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.271343 s, 3.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.282419 s, 3.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260268 s, 4.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243536 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230635 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236371 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264991 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.274199 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239632 s, 4.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.291898 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.287016 s, 3.7 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9e0782cdb800.lock_unused_count=4
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=4
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393306 s, 26.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271118 s, 38.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200585 s, 52.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0492207 s, 21.3 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195873 s, 53.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245188 s, 42.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0689247 s, 15.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262637 s, 39.9 MB/s

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265029 s, 39.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249648 s, 42.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291591 s, 36.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293527 s, 35.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302922 s, 34.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337443 s, 31.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302386 s, 34.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363423 s, 28.9 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 10, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.91235 s, 10.6 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 10
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.90655 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.10092 s, 20.6 MB/s
Write runtime is 7 s, speed is 14.285714 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.88321 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_a
ost.OSS.ost_io.nrs_tbf_rule=stop ext_b
ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.280693 s, 59.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0423964 s, 24.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0477144 s, 22.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139928 s, 7.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137686 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143625 s, 7.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148536 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169617 s, 6.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17755 s, 5.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191595 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179842 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203168 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180307 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198804 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204954 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209309 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224409 s, 4.7 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386819 s, 27.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.037189 s, 28.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.050739 s, 20.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338788 s, 31.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0546645 s, 19.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045439 s, 23.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0434029 s, 24.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401235 s, 26.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408073 s, 25.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.043349 s, 24.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486344 s, 21.6 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0422436 s, 24.8 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0429939 s, 24.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0430103 s, 24.4 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381302 s, 27.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0478144 s, 21.9 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 5, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.6342 s, 5.3 MB/s
Write runtime is 20 s, speed is 5.000000 vs. 5
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.5772 s, 5.4 MB/s
Read runtime is 21 s, speed is 4.761904 vs. 5
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug
ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.477418 s, 35.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0946925 s, 11.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122802 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193316 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180088 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236884 s, 4.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0725433 s, 14.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149694 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189362 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.290822 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214964 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225126 s, 4.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170155 s, 6.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311265 s, 3.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165412 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302405 s, 3.5 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480444 s, 21.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210408 s, 49.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135396 s, 77.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00233343 s, 449 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146953 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0749385 s, 14.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0628913 s, 16.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0556856 s, 18.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0053208 s, 197 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0526109 s, 19.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527039 s, 19.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0479349 s, 21.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271311 s, 38.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361249 s, 29.0 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321003 s, 32.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221327 s, 47.4 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.27226 s, 19.9 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.90079 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw
ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur
ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20
ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.382114 s, 43.9 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0513491 s, 20.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0808743 s, 13.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476504 s, 22.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0703151 s, 14.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103334 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178111 s, 5.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171044 s, 6.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182466 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163361 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190912 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151263 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170928 s, 6.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206212 s, 5.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9e0782cdb800.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=3
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241137 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217704 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.315513 s, 3.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159344 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0804048 s, 13.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0804654 s, 13.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104566 s, 100 MB/s1+0 records in
1+0 records out

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080823 s, 130 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815876 s, 12.9 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106242 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110712 s, 9.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0407601 s, 25.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112241 s, 9.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109866 s, 9.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.099901 s, 10.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101308 s, 10.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183723 s, 5.7 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122925 s, 8.5 MB/s
removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg313-client.virtnet'
removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77k.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 10, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.0539 s, 10.4 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 10
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.91478 s, 10.6 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 10, bs: 1048576
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1048576] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.90776 s, 10.6 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 20
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1048576] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 9.99752 s, 10.5 MB/s
Read runtime is 11 s, speed is 9.090909 vs. 10
cleanup_tbf /mnt/lustre/d77k.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_tbf_rule=stop ext_a
ost.OSS.ost_io.nrs_tbf_rule=stop ext_b
ost.OSS.ost_io.nrs_policies=fifo
PASS 77k (320s)

== sanityn test 77ub: Testing for TBF rate control in BPS performance mode ========================================================== 18:59:36 (1788821976)
ost.OSS.ost_io.nrs_policies=tbf nid+opcode
ost.OSS.ost_io.nrs_tbf_rule=start nidrd nid={0@lo 192.168.203.13@tcp}&opcode={ost_read} bps=5
ost.OSS.ost_io.nrs_tbf_rule=start nidwr nid={0@lo 192.168.203.13@tcp}&opcode={ost_write} bps=15
ost.OSS.ost_io.nrs_tbf_rule=
regular_requests:
CPT 0:
nidwr nid={0@lo 192.168.203.13@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640
nidrd nid={0@lo 192.168.203.13@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880
default * 10000, seq 1, type=nid+opcode, ref 0
high_priority_requests:
CPT 0:
nidwr nid={0@lo 192.168.203.13@tcp}&opcode={ost_write} 15, seq 3, type=nid+opcode, ref 0 bps=15728640
nidrd nid={0@lo 192.168.203.13@tcp}&opcode={ost_read} 5, seq 2, type=nid+opcode, ref 0 bps=5242880
default * 10000, seq 1, type=nid+opcode, ref 0
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.784654 s, 21.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0558852 s, 18.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105623 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0900695 s, 11.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10331 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128864 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.381625 s, 2.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.498674 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.424959 s, 2.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.496759 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.525584 s, 2.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.480918 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.504713 s, 2.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.533118 s, 2.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.566611 s, 1.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.470479 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.485616 s, 2.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.293567 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277626 s, 3.8 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263456 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.287827 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258949 s, 4.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.299267 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277343 s, 3.8 MB/s
1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284652 s, 3.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.275257 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.287516 s, 3.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.332012 s, 3.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302374 s, 3.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.307487 s, 3.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.321466 s, 3.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.329514 s, 3.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.329343 s, 3.2 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9e0782cdb800.lock_unused_count=3
removed '/mnt/lustre/d77ub.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77ub.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77ub.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 4096
Verify the write rate is under TBF control
25600+0 records in
25600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 408.206 s, 257 kB/s
Write runtime is 409 s, speed is .244498 vs. 15
Verify the read rate is under TBF control
25600+0 records in
25600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 152.897 s, 686 kB/s
Read runtime is 154 s, speed is .649350 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 65536
Verify the write rate is under TBF control
1600+0 records in
1600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 32.4874 s, 3.2 MB/s
Write runtime is 33 s, speed is 3.030303 vs. 15
Verify the read rate is under TBF control
1600+0 records in
1600+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 24.2957 s, 4.3 MB/s
Read runtime is 26 s, speed is 3.846153 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 131072
Verify the write rate is under TBF control
800+0 records in
800+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 20.72 s, 5.1 MB/s
Write runtime is 22 s, speed is 4.545454 vs. 15
Verify the read rate is under TBF control
800+0 records in
800+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 22.1319 s, 4.7 MB/s
Read runtime is 23 s, speed is 4.347826 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 262144
Verify the write rate is under TBF control
400+0 records in
400+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 10.0385 s, 10.4 MB/s
Write runtime is 11 s, speed is 9.090909 vs. 15
Verify the read rate is under TBF control
400+0 records in
400+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 20.575 s, 5.1 MB/s
Read runtime is 22 s, speed is 4.545454 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 15, read rate: 5, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.75226 s, 15.5 MB/s
Write runtime is 8 s, speed is 12.500000 vs. 15
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 19.9616 s, 5.3 MB/s
Read runtime is 21 s, speed is 4.761904 vs. 5
cleanup_tbf /mnt/lustre/d77ub.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_tbf_rule=stop nidrd
ost.OSS.ost_io.nrs_tbf_rule=stop nidwr
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ub (804s)

== sanityn test 77ve: mClock: rule Reserved and Limit rate setting ========================================================== 19:13:00 (1788822780)
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
oleg313-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=50: Numerical result out of range
oleg313-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} resvd_rate=100 limit_rate=50': Numerical result out of range
pdsh@oleg313-client: oleg313-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} iops=100
Rule rate: limit_iops 100
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} rate=5MiB/s
Rule rate: limit_bps 5
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_rate=300MiB/s
Rule rate: limit_bps 300
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=300
Rule rate: iops 100-300
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB
Rule rate: bps 10-30
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB resvd_iops=5 limit_iops=25
Rule rate: iops 5-25 bps 10-30
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} bps=5MiB/s
Rule rate: limit_bps 5
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=10MiB/s
ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=100
ost.OSS.ost_io.nrs_mclock_rule=
regular_requests:
CPT 0:
proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0
default *, limit_iops 10000, seq 1, type=projid, ref 0
high_priority_requests:
CPT 0:
proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0
default *, limit_iops 10000, seq 1, type=projid, ref 0
Rule rate: limit_iops 100
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10 limit_rate=300
ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=200
Rule rate: iops 10-200
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=5000B/s
Rule rate: limit_bps 5000B/s
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=1536KiB/s
Rule rate: limit_bps 1572864B/s
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ve (34s)

== sanityn test 77vf: mClock: I/O testing with both Reserved and Limit rate control ========================================================== 19:13:34 (1788822814)
using SAVE_PROJECT_SUPPORTED=0
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=5 limit_rate=20
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.347062 s, 48.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0834415 s, 12.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0826522 s, 12.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154841 s, 6.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161368 s, 6.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187531 s, 5.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142515 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133933 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.230169 s, 4.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204759 s, 5.1 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9e0782cdb800.lock_unused_count=4
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292476 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233988 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300176 s, 3.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.338851 s, 3.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.288697 s, 3.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.276398 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.346807 s, 3.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0425468 s, 24.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573932 s, 18.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573569 s, 18.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0533586 s, 19.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598928 s, 17.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506037 s, 207 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614359 s, 17.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0757125 s, 13.8 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0564601 s, 18.6 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10573 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440176 s, 23.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644157 s, 16.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0694805 s, 15.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671238 s, 15.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388083 s, 27.0 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0674806 s, 15.5 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9e0782cdb800.lock_unused_count=7
removed '/mnt/lustre/d77vf.sanityn/nrs_w_oleg313-client.virtnet'
removed '/mnt/lustre/d77vf.sanityn/nrs_r_oleg313-client.virtnet'
removed directory '/mnt/lustre/d77vf.sanityn'
not_under_control: 0
cpu_npartitions on ost1 is 1
Limited write rate: 20, read rate: 20, bs: 1048576
Verify the write rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.00252 s, 21.0 MB/s
Write runtime is 6 s, speed is 16.666666 vs. 20
Verify the read rate is under TBF control
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.14586 s, 20.4 MB/s
Read runtime is 7 s, speed is 14.285714 vs. 20
cleanup_tbf /mnt/lustre/d77vf.sanityn
Waiting for MDT destroys to complete
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vf (42s)

== sanityn test 77vg: mClock: multiple flows with different reserved and limit rates ========================================================== 19:14:16 (1788822856)
using SAVE_PROJECT_SUPPORTED=0
  100 P /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
  200 P /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=5 limit_rate=20
ost.OSS.ost_io.nrs_mclock_rule=start proj200 projid={200} resvd_rate=10 limit_rate=15
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: w, resvd: 5, limit: 20
WRITE: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: w, resvd: 10, limit: 15
WRITE: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.48525 s, 19.1 MB/s
Write runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.94554 s, 15.1 MB/s
Write runtime is 9 s, speed is 11.111111 IOPS
=== DONE: rate=11.111111 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: r, resvd: 5, limit: 20
READ: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: r, resvd: 10, limit: 15
READ: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.15611 s, 20.3 MB/s
Read runtime is 6 s, speed is 16.666666 IOPS
=== DONE: rate=16.666666 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.7417 s, 15.6 MB/s
Read runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: w, resvd: 10, limit: 15
WRITE: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: r, resvd: 5, limit: 20
READ: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.2313 s, 20.0 MB/s
Read runtime is 7 s, speed is 14.285714 IOPS
=== DONE: rate=14.285714 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.83184 s, 15.3 MB/s
Write runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
cpu_npartitions on ost1 is 1
mClock: Run 2 flows in parallel
mClock - file: /mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200
mClock - rw: r, resvd: 10, limit: 15
READ: resvd=10 limit=15 file=/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200 (np=1)
mClock - file: /mnt/lustre/d77vg.sanityn/f77vg.sanityn.100
mClock - rw: w, resvd: 5, limit: 20
WRITE: resvd=5 limit=20 file=/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100 (np=1)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 5.10105 s, 20.6 MB/s
Write runtime is 6 s, speed is 16.666666 IOPS
=== DONE: rate=16.666666 within 5-20 and np=1 ===
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 6.65223 s, 15.8 MB/s
Read runtime is 8 s, speed is 12.500000 IOPS
=== DONE: rate=12.500000 within 10-15 and np=1 ===
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_mclock_rule=stop proj200
ost.OSS.ost_io.nrs_policies=fifo
removed '/mnt/lustre/d77vg.sanityn/f77vg.sanityn.100'
removed '/mnt/lustre2/d77vg.sanityn/f77vg.sanityn.200'
PASS 77vg (47s)

== sanityn test 77vm: mClock: reserve=0 turns the reserve dimension off ========================================================== 19:15:03 (1788822903)
oleg313-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=mclock projid reserve=0: Invalid argument
oleg313-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='mclock projid reserve=0': Invalid argument
pdsh@oleg313-client: oleg313-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=mclock projid reserve=0 limit=1
ost.OSS.ost_io.nrs_mclock_rule=start lim100 projid={100} limit_rate=100
Rule rate: limit_iops 100
oleg313-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start res100 projid={200} resvd_rate=100: Invalid argument
oleg313-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start res100 projid={200} resvd_rate=100': Invalid argument
pdsh@oleg313-client: oleg313-server: ssh exited with exit code 22
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop lim100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vm (17s)

== sanityn test 77vr: mClock: a reserve only policy schedules the default class ========================================================== 19:15:20 (1788822920)
using SAVE_PROJECT_SUPPORTED=0
ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=0
Default rule rate: resvd_iops 10000
ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100
8+0 records in
8+0 records out
8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.306338 s, 27.4 MB/s
8+0 records in
8+0 records out
8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.231186 s, 36.3 MB/s
Cleanup TBF
ost.OSS.ost_io.nrs_mclock_rule=stop proj100
ost.OSS.ost_io.nrs_policies=fifo
PASS 77vr (15s)
cleanup: ======================================================
== sanityn test complete, duration 1390 sec ============== 19:15:37 (1788822937)
=== sanityn: start cleanup 19:15:39 (1788822939) ===
Stopping clients: oleg313-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg313-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 19:15:43 (1788822943) ===