-----============= acceptance-small: sanityn ============----- Wed Apr 22 14:02:29 EDT 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg301-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a 102
skipping tests SLOW=no: 33a
=== sanityn: start setup 14:02:35 (1776880955) ===
Starting client oleg301-client.virtnet:  -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre2
Mount client oleg301-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.101@tcp:/lustre /mnt/lustre2
Started clients oleg301-client.virtnet: 
192.168.203.101@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg301-client.virtnet: executing check_config_client /mnt/lustre
oleg301-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg301-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff9adc05e66000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff9adc08afd800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9adc05e66000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9adc08afd800.idle_timeout=debug
disable quota as required
oleg301-server: oleg301-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanityn: finish setup 14:02:45 (1776880965) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127345 s, 82.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7542]

== sanityn test 77aa: check NRS fairshare basic smoke (jobid default) ========================================================== 14:02:46 (1776880966)
ost.OSS.ost_io.nrs_policies=fairshare
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.15595 s, 108 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344223 s, 30.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10563 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107532 s, 9.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115862 s, 9.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13775 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126116 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133645 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122649 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123401 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13221 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124545 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158959 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141192 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135963 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164804 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154947 s, 6.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285966 s, 36.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262324 s, 40.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267506 s, 39.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272685 s, 38.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402739 s, 26.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245345 s, 42.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740555 s, 142 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0427909 s, 24.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203317 s, 51.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328735 s, 31.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454781 s, 23.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344187 s, 30.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201746 s, 52.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285611 s, 36.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271043 s, 38.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0549384 s, 19.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9adc08afd800.lock_unused_count=1
removed '/mnt/lustre/d77aa.sanityn/nrs_w_oleg301-client.virtnet'
removed '/mnt/lustre/d77aa.sanityn/nrs_r_oleg301-client.virtnet'
removed directory '/mnt/lustre/d77aa.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77aa (5s)

== sanityn test 77ab: check NRS fairshare mode switching and tunables ========================================================== 14:02:51 (1776880971)
ost.OSS.ost_io.nrs_policies=fairshare nid_fair
ost.OSS.ost_io.nrs_fairshare_opp_threshold=32
ost.OSS.ost_io.nrs_fairshare_opp_threshold=8
ost.OSS.ost_io.nrs_fairshare_delta_ms=250
oleg301-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_delta_ms=999999: Numerical result out of range
oleg301-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_delta_ms'='999999': Numerical result out of range
pdsh@oleg301-client: oleg301-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
oleg301-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=fairshare bogus_mode: Invalid argument
oleg301-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='fairshare bogus_mode': Invalid argument
pdsh@oleg301-client: oleg301-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ab (7s)

== sanityn test 77ac: check NRS fairshare rule parse / start / change / stop ========================================================== 14:02:58 (1776880978)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start r1 uid={500} rate=100
ost.OSS.ost_io.nrs_fairshare_rule=start r2 uid={501,502} rate=500 minrate=10
oleg301-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=start r1 uid={503} rate=1: File exists
oleg301-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='start r1 uid={503} rate=1': File exists
pdsh@oleg301-client: oleg301-server: ssh exited with exit code 17
ost.OSS.ost_io.nrs_fairshare_rule=change r1 rate=200
oleg301-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=change nope rate=1: No such file or directory
oleg301-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='change nope rate=1': No such file or directory
pdsh@oleg301-client: oleg301-server: ssh exited with exit code 2
oleg301-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=garbage r1 rate=1: Invalid argument
oleg301-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='garbage r1 rate=1': Invalid argument
pdsh@oleg301-client: oleg301-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_fairshare_rule=stop r1
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ac (7s)

== sanityn test 77ad: check NRS fairshare rate ceiling dispatches under load ========================================================== 14:03:05 (1776880985)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start rcap uid={0} rate=25600
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.135362 s, 124 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346901 s, 30.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0457393 s, 22.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0651986 s, 16.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0587324 s, 17.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0557211 s, 18.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495665 s, 21.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.084751 s, 12.4 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9adc08afd800.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0976378 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11553 s, 9.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0992704 s, 10.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0986974 s, 10.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0990847 s, 10.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0933166 s, 11.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125522 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100247 s, 10.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123658 s, 8.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161704 s, 64.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185786 s, 56.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197606 s, 53.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238339 s, 44.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221545 s, 47.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200005 s, 52.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018205 s, 57.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00442341 s, 237 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216049 s, 48.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
ldlm.namespaces.lustre-OST0000-osc-ffff9adc08afd800.lock_unused_count=1
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0054755 s, 192 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011835 s, 88.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023843 s, 44.0 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187276 s, 56.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191793 s, 54.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615122 s, 170 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174109 s, 60.2 MB/s
removed '/mnt/lustre/d77ad.sanityn/nrs_r_oleg301-client.virtnet'
removed '/mnt/lustre/d77ad.sanityn/nrs_w_oleg301-client.virtnet'
removed directory '/mnt/lustre/d77ad.sanityn'
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ad (5s)

== sanityn test 77ae: check NRS fairshare composite (A_then_B) mode ========================================================== 14:03:10 (1776880990)
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.141502 s, 119 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334978 s, 31.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406162 s, 25.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.040955 s, 25.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0825835 s, 12.7 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9adc08afd800.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0836058 s, 12.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.097964 s, 10.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0954856 s, 11.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105207 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118831 s, 8.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105706 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109275 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116024 s, 9.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128792 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11583 s, 9.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126473 s, 8.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128253 s, 8.2 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9adc08afd800.lock_unused_count=7
ldlm.namespaces.lustre-OST0001-osc-ffff9adc08afd800.lock_unused_count=2
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136804 s, 76.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169012 s, 62.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124152 s, 84.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868431 s, 121 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230114 s, 45.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166251 s, 63.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847809 s, 124 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014904 s, 70.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139899 s, 75.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175324 s, 59.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108134 s, 97.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222407 s, 47.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00531011 s, 197 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790149 s, 133 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120004 s, 87.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00454886 s, 231 MB/s
removed '/mnt/lustre/d77ae.sanityn/nrs_w_oleg301-client.virtnet'
removed '/mnt/lustre/d77ae.sanityn/nrs_r_oleg301-client.virtnet'
removed directory '/mnt/lustre/d77ae.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ae (5s)

== sanityn test 77af: check NRS fairshare delta kthread and delta_ms round-trip ========================================================== 14:03:15 (1776880995)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_fairshare_delta_ms=1000
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.150672 s, 111 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303177 s, 34.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337613 s, 31.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0656145 s, 16.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0678891 s, 15.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0762126 s, 13.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0600432 s, 17.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0740044 s, 14.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0896894 s, 11.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0906959 s, 11.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105566 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0979684 s, 10.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103014 s, 10.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101543 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0946782 s, 11.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118664 s, 8.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0947632 s, 11.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9adc08afd800.lock_unused_count=2
ldlm.namespaces.lustre-OST0001-osc-ffff9adc08afd800.lock_unused_count=1
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197018 s, 53.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204209 s, 51.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185709 s, 56.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173522 s, 60.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168843 s, 62.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153368 s, 68.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283681 s, 37.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016205 s, 64.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212447 s, 49.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182917 s, 57.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023291 s, 45.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00383647 s, 273 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028278 s, 37.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647521 s, 162 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00441975 s, 237 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569046 s, 184 MB/s
removed '/mnt/lustre/d77af.sanityn/nrs_r_oleg301-client.virtnet'
removed '/mnt/lustre/d77af.sanityn/nrs_w_oleg301-client.virtnet'
removed directory '/mnt/lustre/d77af.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77af (7s)

== sanityn test 77ag: check NRS fairshare locality tunable and BRW ordering ========================================================== 14:03:22 (1776881002)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_locality=off
ost.OSS.ost_io.nrs_fairshare_locality=on
ost.OSS.ost_io.nrs_fairshare_locality=auto
ost.OSS.ost_io.nrs_fairshare_locality=on
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.160707 s, 104 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330506 s, 31.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375186 s, 27.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0733498 s, 14.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0912785 s, 11.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110219 s, 9.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0959955 s, 10.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104226 s, 10.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125197 s, 8.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103299 s, 10.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128484 s, 8.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129976 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122911 s, 8.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117134 s, 9.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111156 s, 9.4 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113472 s, 9.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110793 s, 9.5 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9adc08afd800.lock_unused_count=6
ldlm.namespaces.lustre-OST0001-osc-ffff9adc08afd800.lock_unused_count=5
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152201 s, 68.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155732 s, 67.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155824 s, 67.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143235 s, 73.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116528 s, 90.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114893 s, 91.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172427 s, 60.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126814 s, 82.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213098 s, 49.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254376 s, 41.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.003722 s, 282 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076915 s, 136 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025058 s, 41.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564714 s, 186 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059204 s, 177 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818829 s, 128 MB/s
removed '/mnt/lustre/d77ag.sanityn/nrs_w_oleg301-client.virtnet'
removed '/mnt/lustre/d77ag.sanityn/nrs_r_oleg301-client.virtnet'
removed directory '/mnt/lustre/d77ag.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ag (6s)

== sanityn test 77ah: verify NRS fairshare minrate floor under congestion ========================================================== 14:03:28 (1776881008)

 SKIP: sanityn test_77ah need OSTs and MDTs on separate nodes
SKIP 77ah (1s)
cleanup: ======================================================
== sanityn test complete, duration 61 sec ================ 14:03:30 (1776881010)
=== sanityn: start cleanup 14:03:30 (1776881010) ===
Stopping clients: oleg301-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg301-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 14:03:32 (1776881012) ===