-----============= acceptance-small: sanityn ============----- Wed Apr 22 14:02:50 EDT 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg104-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a
skipping tests SLOW=no: 33a
=== sanityn: start setup 14:02:57 (1776880977) ===
Starting client oleg104-client.virtnet:  -o user_xattr,flock 192.168.201.104@tcp:/lustre /mnt/lustre2
Mount client oleg104-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.104@tcp:/lustre /mnt/lustre2
Started clients oleg104-client.virtnet: 
192.168.201.104@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg104-client.virtnet: executing check_config_client /mnt/lustre
oleg104-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg104-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff9d4fe15e1000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff9d4fe181f000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9d4fe15e1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff9d4fe181f000.idle_timeout=debug
disable quota as required
oleg104-server: oleg104-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
osd-ldiskfs.track_declares_assert=1
=== sanityn: finish setup 14:03:09 (1776880989) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208323 s, 50.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f8200]

== sanityn test 77aa: check NRS fairshare basic smoke (jobid default) ========================================================== 14:03:10 (1776880990)
ost.OSS.ost_io.nrs_policies=fairshare
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.154849 s, 108 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0719723 s, 14.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0602247 s, 17.4 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9d4fe181f000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163216 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156729 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148593 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15855 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214454 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215213 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209711 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192554 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198993 s, 5.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226511 s, 4.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.216327 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213294 s, 4.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194386 s, 5.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190995 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115202 s, 91.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363688 s, 28.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754759 s, 139 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314975 s, 33.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031857 s, 32.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346705 s, 30.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0441806 s, 23.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0528274 s, 19.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581844 s, 180 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258362 s, 40.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266815 s, 39.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0404361 s, 25.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0119009 s, 88.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350472 s, 29.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246525 s, 42.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825938 s, 127 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9d4fe181f000.lock_unused_count=2
removed '/mnt/lustre/d77aa.sanityn/nrs_r_oleg104-client.virtnet'
removed '/mnt/lustre/d77aa.sanityn/nrs_w_oleg104-client.virtnet'
removed directory '/mnt/lustre/d77aa.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77aa (5s)

== sanityn test 77ab: check NRS fairshare mode switching and tunables ========================================================== 14:03:15 (1776880995)
ost.OSS.ost_io.nrs_policies=fairshare nid_fair
ost.OSS.ost_io.nrs_fairshare_opp_threshold=32
ost.OSS.ost_io.nrs_fairshare_opp_threshold=8
ost.OSS.ost_io.nrs_fairshare_delta_ms=250
oleg104-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_delta_ms=999999: Numerical result out of range
oleg104-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_delta_ms'='999999': Numerical result out of range
pdsh@oleg104-client: oleg104-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
oleg104-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=fairshare bogus_mode: Invalid argument
oleg104-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='fairshare bogus_mode': Invalid argument
pdsh@oleg104-client: oleg104-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ab (7s)

== sanityn test 77ac: check NRS fairshare rule parse / start / change / stop ========================================================== 14:03:22 (1776881002)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start r1 uid={500} rate=100
ost.OSS.ost_io.nrs_fairshare_rule=start r2 uid={501,502} rate=500 minrate=10
oleg104-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=start r1 uid={503} rate=1: File exists
oleg104-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='start r1 uid={503} rate=1': File exists
pdsh@oleg104-client: oleg104-server: ssh exited with exit code 17
ost.OSS.ost_io.nrs_fairshare_rule=change r1 rate=200
oleg104-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=change nope rate=1: No such file or directory
oleg104-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='change nope rate=1': No such file or directory
pdsh@oleg104-client: oleg104-server: ssh exited with exit code 2
oleg104-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=garbage r1 rate=1: Invalid argument
oleg104-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='garbage r1 rate=1': Invalid argument
pdsh@oleg104-client: oleg104-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_fairshare_rule=stop r1
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ac (8s)

== sanityn test 77ad: check NRS fairshare rate ceiling dispatches under load ========================================================== 14:03:30 (1776881010)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start rcap uid={0} rate=25600
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.162481 s, 103 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455416 s, 23.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0569346 s, 18.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0635154 s, 16.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0897872 s, 11.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.067917 s, 15.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0788135 s, 13.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0870361 s, 12.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0929283 s, 11.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0905168 s, 11.6 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9d4fe181f000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129879 s, 8.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135996 s, 7.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147239 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141506 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.162352 s, 6.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14723 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149394 s, 7.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205438 s, 51.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199838 s, 52.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209414 s, 50.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206013 s, 50.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179241 s, 58.5 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256674 s, 40.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106085 s, 98.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224665 s, 46.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01332 s, 78.7 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9d4fe181f000.lock_unused_count=7
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837594 s, 125 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114842 s, 91.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152262 s, 68.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207742 s, 50.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191432 s, 54.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112212 s, 93.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062962 s, 167 MB/s
removed '/mnt/lustre/d77ad.sanityn/nrs_r_oleg104-client.virtnet'
removed '/mnt/lustre/d77ad.sanityn/nrs_w_oleg104-client.virtnet'
removed directory '/mnt/lustre/d77ad.sanityn'
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ad (5s)

== sanityn test 77ae: check NRS fairshare composite (A_then_B) mode ========================================================== 14:03:35 (1776881015)
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.16963 s, 98.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416673 s, 25.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0580288 s, 18.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0697004 s, 15.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805591 s, 13.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0562868 s, 18.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0911948 s, 11.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060715 s, 17.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0746855 s, 14.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101412 s, 10.3 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff9d4fe181f000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150293 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168855 s, 6.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142268 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141422 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166004 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011393 s, 92.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161065 s, 6.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022271 s, 47.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426643 s, 24.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231818 s, 45.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00386544 s, 271 MB/s1+0 records in
1+0 records out

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0516245 s, 20.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833479 s, 126 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00431502 s, 243 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00428089 s, 245 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00441569 s, 237 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.166653 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266231 s, 39.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249712 s, 42.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281268 s, 37.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.050614 s, 20.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021404 s, 49.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577205 s, 182 MB/s
removed '/mnt/lustre/d77ae.sanityn/nrs_r_oleg104-client.virtnet'
removed '/mnt/lustre/d77ae.sanityn/nrs_w_oleg104-client.virtnet'
removed directory '/mnt/lustre/d77ae.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ae (5s)

== sanityn test 77af: check NRS fairshare delta kthread and delta_ms round-trip ========================================================== 14:03:41 (1776881021)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_fairshare_delta_ms=1000
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.169988 s, 98.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0521797 s, 20.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661087 s, 15.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163112 s, 6.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202289 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189792 s, 5.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209131 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247739 s, 4.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.246934 s, 4.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247673 s, 4.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226548 s, 4.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269773 s, 3.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232527 s, 4.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218277 s, 4.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245479 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.24095 s, 4.4 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9d4fe181f000.lock_unused_count=6
ldlm.namespaces.lustre-OST0001-osc-ffff9d4fe181f000.lock_unused_count=6
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612938 s, 171 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189909 s, 55.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224664 s, 46.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00434039 s, 242 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0393637 s, 26.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239346 s, 43.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311805 s, 33.6 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277192 s, 37.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315983 s, 33.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0464625 s, 22.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264407 s, 39.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349473 s, 30.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026931 s, 38.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279073 s, 3.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277467 s, 37.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241726 s, 43.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0505642 s, 20.7 MB/s
removed '/mnt/lustre/d77af.sanityn/nrs_r_oleg104-client.virtnet'
removed '/mnt/lustre/d77af.sanityn/nrs_w_oleg104-client.virtnet'
removed directory '/mnt/lustre/d77af.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77af (7s)

== sanityn test 77ag: check NRS fairshare locality tunable and BRW ordering ========================================================== 14:03:47 (1776881027)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_locality=off
ost.OSS.ost_io.nrs_fairshare_locality=on
ost.OSS.ost_io.nrs_fairshare_locality=auto
ost.OSS.ost_io.nrs_fairshare_locality=on
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.161045 s, 104 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0765615 s, 13.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0830017 s, 12.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0718571 s, 14.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101096 s, 10.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0832371 s, 12.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113691 s, 9.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14257 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15402 s, 6.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150158 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165189 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210228 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206948 s, 5.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210601 s, 5.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241499 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.243604 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203255 s, 5.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281335 s, 37.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270473 s, 38.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0413891 s, 25.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0444503 s, 23.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440344 s, 23.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0450874 s, 23.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314753 s, 33.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0358961 s, 29.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399677 s, 26.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0377896 s, 27.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375627 s, 27.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0500852 s, 20.9 MB/s1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406601 s, 25.8 MB/s

1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402741 s, 26.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354573 s, 29.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542063 s, 19.3 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff9d4fe181f000.lock_unused_count=6
ldlm.namespaces.lustre-OST0001-osc-ffff9d4fe181f000.lock_unused_count=6
removed '/mnt/lustre/d77ag.sanityn/nrs_r_oleg104-client.virtnet'
removed '/mnt/lustre/d77ag.sanityn/nrs_w_oleg104-client.virtnet'
removed directory '/mnt/lustre/d77ag.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ag (7s)

== sanityn test 77ah: verify NRS fairshare minrate floor under congestion ========================================================== 14:03:54 (1776881034)

 SKIP: sanityn test_77ah need OSTs and MDTs on separate nodes
SKIP 77ah (1s)
cleanup: ======================================================
== sanityn test complete, duration 65 sec ================ 14:03:56 (1776881036)
=== sanityn: start cleanup 14:03:56 (1776881036) ===
Stopping clients: oleg104-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg104-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 14:03:58 (1776881038) ===