== sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 02:14:36 (1733814876)
jobid_var=procname_uid
ost.OSS.ost_io.nrs_policies=tbf uid
ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5
running as uid/gid/euid/egid 0/500/0/500, groups: 500
 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet]
running as uid/gid/euid/egid 0/500/0/500, groups: 500
 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet]
running as uid/gid/euid/egid 0/500/0/500, groups: 500
 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB) copied, 0.274656 s, 61.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0190704 s, 55.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0218555 s, 48.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0290913 s, 36.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0309066 s, 33.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0310129 s, 33.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0409618 s, 25.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.044012 s, 23.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0488052 s, 21.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0140187 s, 74.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0131801 s, 79.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0148168 s, 70.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0125575 s, 83.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0126491 s, 82.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0291248 s, 36.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0266668 s, 39.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0651833 s, 16.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0174363 s, 60.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0156366 s, 67.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0187056 s, 56.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0178937 s, 58.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0200355 s, 52.3 MB/s
1048576 bytes (1.0 MB) copied, 0.0170183 s, 61.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0145937 s, 71.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0160085 s, 65.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0175805 s, 59.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0175393 s, 59.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0172701 s, 60.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0180021 s, 58.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0186021 s, 56.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied1+0 records in
1+0 records out
, 0.0184054 s, 57.0 MB/s
1048576 bytes (1.0 MB) copied, 0.0176789 s, 59.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0188598 s, 55.6 MB/s
removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet'
removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet'
removed directory: '/mnt/lustre/d77jb.sanityn'
cpu_npartitions on ost1 is 1
running as uid/gid/euid/egid 0/500/0/500, groups: 500
 [touch] [/mnt/lustre/d77jb.sanityn/tbf]
Limited write rate: 5, read rate: 5
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 19.829 s, 5.3 MB/s
Write runtime is 21 s, speed is 4.761904 IOPS
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 19.9614 s, 5.3 MB/s
Read runtime is 21 s, speed is 4.761904 IOPS
cleanup_tbf /mnt/lustre/d77jb.sanityn
Waiting for MDT destroys to complete
oleg352-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported
oleg352-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported
pdsh@oleg352-client: oleg352-server: ssh exited with exit code 1
pdsh@oleg352-client: oleg352-server: ssh exited with exit code 1
ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid
ost.OSS.ost_io.nrs_policies=fifo
jobid_var=procname_uid
ost.OSS.ost_io.nrs_policies=tbf gid
ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5
running as uid/gid/euid/egid 500/0/500/0, groups: 0
 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet]
running as uid/gid/euid/egid 500/0/500/0, groups: 0
 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet]
running as uid/gid/euid/egid 500/0/500/0, groups: 0
 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet] [bs=1M] [count=16]
16+0 records in
16+0 records out
16777216 bytes (17 MB) copied, 0.258842 s, 64.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_w]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00981063 s, 107 MB/s
, 0.0115618 s, 90.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0105649 s, 99.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0148687 s, 70.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0194622 s, 53.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00718386 s, 146 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0216025 s, 48.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00614539 s, 171 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00979389 s, 107 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00877748 s, 119 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00767991 s, 137 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00962766 s, 109 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.014228 s, 73.7 MB/s
, 0.0200979 s, 52.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0102305 s, 102 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0298099 s, 35.2 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [declare] [-a] [pids_r]
execvp fails running declare (13): Permission denied
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00797915 s, 131 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00971824 s, 108 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0066776 s, 157 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00914216 s, 115 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00924881 s, 113 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.01039 s, 101 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0101186 s, 104 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00829325 s, 126 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0106099 s, 98.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00948053 s, 111 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.0101112 s, 104 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.010087 s, 104 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.00992236 s, 106 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00971804 s, 108 MB/s
, 0.0112025 s, 93.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB) copied, 0.011602 s, 90.4 MB/s
removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg352-client.virtnet'
removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg352-client.virtnet'
removed directory: '/mnt/lustre/d77jb.sanityn'
cpu_npartitions on ost1 is 1
running as uid/gid/euid/egid 500/0/500/0, groups: 0
 [touch] [/mnt/lustre/d77jb.sanityn/tbf]
Limited write rate: 5, read rate: 5
Verify the write rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 19.8309 s, 5.3 MB/s
Write runtime is 20 s, speed is 5.000000 IOPS
Verify the read rate is under TBF control
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct]
100+0 records in
100+0 records out
104857600 bytes (105 MB) copied, 19.95 s, 5.3 MB/s
Read runtime is 20 s, speed is 5.000000 IOPS
cleanup_tbf /mnt/lustre/d77jb.sanityn
Waiting for MDT destroys to complete
oleg352-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported
pdsh@oleg352-client: oleg352-server: ssh exited with exit code 1
oleg352-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported
pdsh@oleg352-client: oleg352-server: ssh exited with exit code 1
ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid
ost.OSS.ost_io.nrs_policies=fifo