-----============= acceptance-small: sanityn ============----- Wed Apr 22 14:02:35 EDT 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg312-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a 102
skipping tests SLOW=no: 33a
=== sanityn: start setup 14:02:41 (1776880961) ===
Starting client oleg312-client.virtnet:  -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre2
Mount client oleg312-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.112@tcp:/lustre /mnt/lustre2
Started clients oleg312-client.virtnet: 
192.168.203.112@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg312-client.virtnet: executing check_config_client /mnt/lustre
oleg312-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg312-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff932e034b2000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff932e09067000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff932e034b2000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff932e09067000.idle_timeout=debug
disable quota as required
oleg312-server: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanityn: finish setup 14:02:51 (1776880971) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174696 s, 60.0 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7567]

== sanityn test 77aa: check NRS fairshare basic smoke (jobid default) ========================================================== 14:02:52 (1776880972)
ost.OSS.ost_io.nrs_policies=fairshare
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.13214 s, 127 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036424 s, 28.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030719 s, 34.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0948465 s, 11.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103704 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113117 s, 9.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116571 s, 9.0 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=2
ldlm.namespaces.lustre-OST0001-osc-ffff932e09067000.lock_unused_count=2
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112654 s, 9.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104561 s, 10.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130338 s, 8.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113577 s, 9.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109625 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110766 s, 9.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125305 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143756 s, 7.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135832 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135481 s, 7.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224298 s, 46.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182786 s, 57.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157781 s, 66.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239325 s, 43.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303743 s, 34.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236763 s, 44.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223431 s, 46.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246428 s, 42.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218957 s, 47.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199241 s, 52.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02107 s, 49.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116754 s, 89.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114173 s, 91.8 MB/s
1+0 records in
1+0 records out
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=2
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00363498 s, 288 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700291 s, 150 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101962 s, 103 MB/s
removed '/mnt/lustre/d77aa.sanityn/nrs_r_oleg312-client.virtnet'
removed '/mnt/lustre/d77aa.sanityn/nrs_w_oleg312-client.virtnet'
removed directory '/mnt/lustre/d77aa.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77aa (5s)

== sanityn test 77ab: check NRS fairshare mode switching and tunables ========================================================== 14:02:57 (1776880977)
ost.OSS.ost_io.nrs_policies=fairshare nid_fair
ost.OSS.ost_io.nrs_fairshare_opp_threshold=32
ost.OSS.ost_io.nrs_fairshare_opp_threshold=8
ost.OSS.ost_io.nrs_fairshare_delta_ms=250
oleg312-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_delta_ms=999999: Numerical result out of range
oleg312-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_delta_ms'='999999': Numerical result out of range
pdsh@oleg312-client: oleg312-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
oleg312-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=fairshare bogus_mode: Invalid argument
oleg312-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='fairshare bogus_mode': Invalid argument
pdsh@oleg312-client: oleg312-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ab (6s)

== sanityn test 77ac: check NRS fairshare rule parse / start / change / stop ========================================================== 14:03:03 (1776880983)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start r1 uid={500} rate=100
ost.OSS.ost_io.nrs_fairshare_rule=start r2 uid={501,502} rate=500 minrate=10
oleg312-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=start r1 uid={503} rate=1: File exists
oleg312-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='start r1 uid={503} rate=1': File exists
pdsh@oleg312-client: oleg312-server: ssh exited with exit code 17
ost.OSS.ost_io.nrs_fairshare_rule=change r1 rate=200
oleg312-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=change nope rate=1: No such file or directory
oleg312-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='change nope rate=1': No such file or directory
pdsh@oleg312-client: oleg312-server: ssh exited with exit code 2
oleg312-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=garbage r1 rate=1: Invalid argument
oleg312-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='garbage r1 rate=1': Invalid argument
pdsh@oleg312-client: oleg312-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_fairshare_rule=stop r1
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ac (7s)

== sanityn test 77ad: check NRS fairshare rate ceiling dispatches under load ========================================================== 14:03:11 (1776880991)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start rcap uid={0} rate=25600
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.13018 s, 129 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296157 s, 35.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359726 s, 29.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0772488 s, 13.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0890668 s, 11.8 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff932e09067000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0895221 s, 11.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0983326 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0893683 s, 11.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109431 s, 9.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0827993 s, 12.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104168 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0982341 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103635 s, 10.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0953751 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126809 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122498 s, 8.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108066 s, 9.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199003 s, 52.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155878 s, 67.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198306 s, 52.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917225 s, 114 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175068 s, 59.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177962 s, 58.9 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189027 s, 55.5 MB/s
1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178135 s, 58.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140529 s, 74.6 MB/sldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=2
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00438841 s, 239 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00398972 s, 263 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130796 s, 80.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990619 s, 106 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00509044 s, 206 MB/s1+0 records in
1+0 records out

1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107831 s, 97.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103965 s, 101 MB/s
removed '/mnt/lustre/d77ad.sanityn/nrs_r_oleg312-client.virtnet'
removed '/mnt/lustre/d77ad.sanityn/nrs_w_oleg312-client.virtnet'
removed directory '/mnt/lustre/d77ad.sanityn'
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ad (4s)

== sanityn test 77ae: check NRS fairshare composite (A_then_B) mode ========================================================== 14:03:15 (1776880995)
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.118087 s, 142 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02712 s, 38.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396326 s, 26.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363017 s, 28.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0466476 s, 22.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0747265 s, 14.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0982218 s, 10.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0880022 s, 11.9 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff932e09067000.lock_unused_count=2
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0999653 s, 10.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0962045 s, 10.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125267 s, 8.4 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120758 s, 8.7 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123288 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0709173 s, 14.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102082 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984406 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0975551 s, 10.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178623 s, 58.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151309 s, 69.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163771 s, 64.0 MB/s
1+0 records in
1+0 records out
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135637 s, 77.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025718 s, 40.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622833 s, 168 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267989 s, 39.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260785 s, 40.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286548 s, 36.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255202 s, 41.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980419 s, 107 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00365989 s, 287 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155411 s, 67.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243875 s, 43.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109103 s, 96.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015834 s, 66.2 MB/s
removed '/mnt/lustre/d77ae.sanityn/nrs_w_oleg312-client.virtnet'
removed '/mnt/lustre/d77ae.sanityn/nrs_r_oleg312-client.virtnet'
removed directory '/mnt/lustre/d77ae.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ae (5s)

== sanityn test 77af: check NRS fairshare delta kthread and delta_ms round-trip ========================================================== 14:03:21 (1776881001)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_fairshare_delta_ms=1000
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.138238 s, 121 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342182 s, 30.6 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0405513 s, 25.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399849 s, 26.2 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0867258 s, 12.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0724426 s, 14.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104898 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105872 s, 9.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0867639 s, 12.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0878498 s, 11.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0763615 s, 13.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0856341 s, 12.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.092381 s, 11.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101375 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119172 s, 8.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0828518 s, 12.7 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff932e09067000.lock_unused_count=7
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0944846 s, 11.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843088 s, 124 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213778 s, 49.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016877 s, 62.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177751 s, 59.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228735 s, 45.8 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874984 s, 120 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245019 s, 42.8 MB/s
1+0 records in
1+0 records out

1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176697 s, 59.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024417 s, 42.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284847 s, 36.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247522 s, 42.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187081 s, 56.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168274 s, 62.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010885 s, 96.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311727 s, 33.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154052 s, 68.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=1
removed '/mnt/lustre/d77af.sanityn/nrs_w_oleg312-client.virtnet'
removed '/mnt/lustre/d77af.sanityn/nrs_r_oleg312-client.virtnet'
removed directory '/mnt/lustre/d77af.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77af (7s)

== sanityn test 77ag: check NRS fairshare locality tunable and BRW ordering ========================================================== 14:03:27 (1776881007)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_locality=off
ost.OSS.ost_io.nrs_fairshare_locality=on
ost.OSS.ost_io.nrs_fairshare_locality=auto
ost.OSS.ost_io.nrs_fairshare_locality=on
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.140532 s, 119 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376524 s, 27.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240886 s, 43.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0916586 s, 11.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118563 s, 8.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0960946 s, 10.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0958238 s, 10.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105917 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111793 s, 9.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120613 s, 8.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131208 s, 8.0 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff932e09067000.lock_unused_count=5
ldlm.namespaces.lustre-OST0001-osc-ffff932e09067000.lock_unused_count=3
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12868 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124084 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131898 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142118 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127535 s, 8.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159587 s, 6.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684621 s, 153 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237025 s, 44.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214862 s, 48.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313219 s, 33.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353894 s, 29.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291522 s, 36.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312403 s, 33.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023243 s, 45.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269493 s, 38.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265705 s, 39.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282952 s, 37.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264699 s, 39.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349524 s, 30.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295595 s, 35.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289727 s, 36.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306187 s, 34.2 MB/s
removed '/mnt/lustre/d77ag.sanityn/nrs_r_oleg312-client.virtnet'
removed '/mnt/lustre/d77ag.sanityn/nrs_w_oleg312-client.virtnet'
removed directory '/mnt/lustre/d77ag.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ag (6s)

== sanityn test 77ah: verify NRS fairshare minrate floor under congestion ========================================================== 14:03:33 (1776881013)

 SKIP: sanityn test_77ah need OSTs and MDTs on separate nodes
SKIP 77ah (1s)
cleanup: ======================================================
== sanityn test complete, duration 60 sec ================ 14:03:35 (1776881015)
=== sanityn: start cleanup 14:03:35 (1776881015) ===
Stopping clients: oleg312-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg312-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 14:03:37 (1776881017) ===