-----============= acceptance-small: sanityn ============----- Wed Apr 22 14:02:42 EDT 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg457-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a
skipping tests SLOW=no: 33a
=== sanityn: start setup 14:02:48 (1776880968) ===
Starting client oleg457-client.virtnet:  -o user_xattr,flock 192.168.204.157@tcp:/lustre /mnt/lustre2
Mount client oleg457-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.204.157@tcp:/lustre /mnt/lustre2
Started clients oleg457-client.virtnet: 
192.168.204.157@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg457-client.virtnet: executing check_config_client /mnt/lustre
oleg457-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg457-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff949ec590c000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff949ed8a6e000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff949ec590c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff949ed8a6e000.idle_timeout=debug
disable quota as required
oleg457-server: oleg457-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
osd-ldiskfs.track_declares_assert=1
=== sanityn: finish setup 14:02:58 (1776880978) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128788 s, 81.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7427]

== sanityn test 77aa: check NRS fairshare basic smoke (jobid default) ========================================================== 14:03:00 (1776880980)
ost.OSS.ost_io.nrs_policies=fairshare
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.145355 s, 115 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0704171 s, 14.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0803783 s, 13.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0902721 s, 11.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0927897 s, 11.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0705338 s, 14.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105623 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102001 s, 10.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0996558 s, 10.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0962595 s, 10.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221034 s, 47.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0606611 s, 17.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0367604 s, 28.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235786 s, 44.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00264011 s, 397 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194797 s, 5.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642813 s, 163 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360134 s, 29.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0468565 s, 22.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0453635 s, 23.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0403282 s, 26.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19165 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00299984 s, 350 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0481275 s, 21.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189255 s, 5.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536406 s, 19.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264244 s, 39.7 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff949ec590c000.lock_unused_count=6
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189632 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352277 s, 29.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19863 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204275 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21235 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105423 s, 99.5 MB/s
removed '/mnt/lustre/d77aa.sanityn/nrs_w_oleg457-client.virtnet'
removed '/mnt/lustre/d77aa.sanityn/nrs_r_oleg457-client.virtnet'
removed directory '/mnt/lustre/d77aa.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77aa (4s)

== sanityn test 77ab: check NRS fairshare mode switching and tunables ========================================================== 14:03:04 (1776880984)
ost.OSS.ost_io.nrs_policies=fairshare nid_fair
ost.OSS.ost_io.nrs_fairshare_opp_threshold=32
ost.OSS.ost_io.nrs_fairshare_opp_threshold=8
ost.OSS.ost_io.nrs_fairshare_delta_ms=250
oleg457-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_delta_ms=999999: Numerical result out of range
oleg457-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_delta_ms'='999999': Numerical result out of range
pdsh@oleg457-client: oleg457-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
oleg457-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=fairshare bogus_mode: Invalid argument
oleg457-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='fairshare bogus_mode': Invalid argument
pdsh@oleg457-client: oleg457-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ab (7s)

== sanityn test 77ac: check NRS fairshare rule parse / start / change / stop ========================================================== 14:03:11 (1776880991)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start r1 uid={500} rate=100
ost.OSS.ost_io.nrs_fairshare_rule=start r2 uid={501,502} rate=500 minrate=10
oleg457-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=start r1 uid={503} rate=1: File exists
oleg457-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='start r1 uid={503} rate=1': File exists
pdsh@oleg457-client: oleg457-server: ssh exited with exit code 17
ost.OSS.ost_io.nrs_fairshare_rule=change r1 rate=200
oleg457-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=change nope rate=1: No such file or directory
oleg457-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='change nope rate=1': No such file or directory
pdsh@oleg457-client: oleg457-server: ssh exited with exit code 2
oleg457-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=garbage r1 rate=1: Invalid argument
oleg457-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='garbage r1 rate=1': Invalid argument
pdsh@oleg457-client: oleg457-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_fairshare_rule=stop r1
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ac (7s)

== sanityn test 77ad: check NRS fairshare rate ceiling dispatches under load ========================================================== 14:03:18 (1776880998)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start rcap uid={0} rate=25600
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.156085 s, 107 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0522521 s, 20.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0512938 s, 20.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565302 s, 18.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0678419 s, 15.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109865 s, 9.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143806 s, 7.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117368 s, 8.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137701 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139149 s, 7.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131796 s, 8.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135376 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150583 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156978 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14725 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170891 s, 6.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17893 s, 5.9 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff949ec590c000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff949ec590c000.lock_unused_count=6
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205847 s, 50.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020653 s, 50.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168984 s, 62.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167014 s, 62.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019589 s, 53.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118801 s, 88.3 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206976 s, 50.7 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211972 s, 49.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220851 s, 47.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368899 s, 28.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204104 s, 51.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278397 s, 37.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275325 s, 38.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0404441 s, 25.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0339994 s, 30.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030111 s, 34.8 MB/s
removed '/mnt/lustre/d77ad.sanityn/nrs_w_oleg457-client.virtnet'
removed '/mnt/lustre/d77ad.sanityn/nrs_r_oleg457-client.virtnet'
removed directory '/mnt/lustre/d77ad.sanityn'
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ad (5s)

== sanityn test 77ae: check NRS fairshare composite (A_then_B) mode ========================================================== 14:03:23 (1776881003)
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.158946 s, 106 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0531124 s, 19.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133354 s, 7.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157364 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159092 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143395 s, 7.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156214 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174314 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186907 s, 5.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198424 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192021 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19648 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200438 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223333 s, 4.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218733 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213217 s, 4.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261348 s, 40.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615429 s, 170 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618161 s, 170 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235764 s, 44.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217065 s, 4.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188404 s, 55.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283014 s, 37.1 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264599 s, 39.6 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315033 s, 33.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393047 s, 26.7 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612238 s, 171 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00326366 s, 321 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019704 s, 53.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322729 s, 32.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115998 s, 90.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598002 s, 175 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00299717 s, 350 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff949ec590c000.lock_unused_count=5
ldlm.namespaces.lustre-OST0001-osc-ffff949ec590c000.lock_unused_count=3
removed '/mnt/lustre/d77ae.sanityn/nrs_w_oleg457-client.virtnet'
removed '/mnt/lustre/d77ae.sanityn/nrs_r_oleg457-client.virtnet'
removed directory '/mnt/lustre/d77ae.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ae (5s)

== sanityn test 77af: check NRS fairshare delta kthread and delta_ms round-trip ========================================================== 14:03:28 (1776881008)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_fairshare_delta_ms=1000
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.150718 s, 111 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0412818 s, 25.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128112 s, 8.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151026 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127155 s, 8.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15697 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179865 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152598 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195912 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175865 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17096 s, 6.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182464 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174596 s, 6.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194357 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187853 s, 5.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184496 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183059 s, 5.7 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff949ec590c000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff949ec590c000.lock_unused_count=4
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221817 s, 47.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235856 s, 44.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024639 s, 42.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216283 s, 48.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238285 s, 44.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243899 s, 43.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00421625 s, 249 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0131911 s, 79.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230284 s, 45.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024266 s, 43.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295584 s, 35.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325315 s, 32.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00479644 s, 219 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651701 s, 161 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574421 s, 183 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646096 s, 162 MB/s
removed '/mnt/lustre/d77af.sanityn/nrs_w_oleg457-client.virtnet'
removed '/mnt/lustre/d77af.sanityn/nrs_r_oleg457-client.virtnet'
removed directory '/mnt/lustre/d77af.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77af (7s)

== sanityn test 77ag: check NRS fairshare locality tunable and BRW ordering ========================================================== 14:03:35 (1776881015)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_locality=off
ost.OSS.ost_io.nrs_fairshare_locality=on
ost.OSS.ost_io.nrs_fairshare_locality=auto
ost.OSS.ost_io.nrs_fairshare_locality=on
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.179121 s, 93.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0623524 s, 16.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0830699 s, 12.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129001 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121028 s, 8.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0995487 s, 10.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154866 s, 6.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19595 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179842 s, 5.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181131 s, 5.8 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174027 s, 6.0 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183535 s, 5.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202856 s, 5.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245497 s, 4.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252456 s, 4.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308363 s, 34.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326419 s, 32.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0427 s, 24.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442648 s, 23.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235364 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269948 s, 38.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301561 s, 34.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318188 s, 33.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034832 s, 30.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071626 s, 146 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0464433 s, 22.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0485858 s, 21.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573186 s, 183 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0609809 s, 17.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440542 s, 23.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169818 s, 61.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.276148 s, 3.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059128 s, 177 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff949ec590c000.lock_unused_count=3
ldlm.namespaces.lustre-OST0001-osc-ffff949ec590c000.lock_unused_count=5
removed '/mnt/lustre/d77ag.sanityn/nrs_w_oleg457-client.virtnet'
removed '/mnt/lustre/d77ag.sanityn/nrs_r_oleg457-client.virtnet'
removed directory '/mnt/lustre/d77ag.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ag (6s)

== sanityn test 77ah: verify NRS fairshare minrate floor under congestion ========================================================== 14:03:41 (1776881021)

 SKIP: sanityn test_77ah need OSTs and MDTs on separate nodes
SKIP 77ah (1s)
cleanup: ======================================================
== sanityn test complete, duration 61 sec ================ 14:03:43 (1776881023)
=== sanityn: start cleanup 14:03:44 (1776881024) ===
Stopping clients: oleg457-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg457-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 14:03:45 (1776881025) ===