-----============= acceptance-small: sanityn ============----- Wed Apr 22 14:02:47 EDT 2026
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
oleg339-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory
excepting tests: 40a 102
skipping tests SLOW=no: 33a
=== sanityn: start setup 14:02:53 (1776880973) ===
Starting client oleg339-client.virtnet:  -o user_xattr,flock 192.168.203.139@tcp:/lustre /mnt/lustre2
Mount client oleg339-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.203.139@tcp:/lustre /mnt/lustre2
Started clients oleg339-client.virtnet: 
192.168.203.139@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg339-client.virtnet: executing check_config_client /mnt/lustre
oleg339-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg339-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff965fc7c59800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff965fc8c33000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff965fc7c59800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff965fc8c33000.idle_timeout=debug
disable quota as required
oleg339-server: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanityn: finish setup 14:03:04 (1776880984) ===
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205713 s, 51.0 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f8369]

== sanityn test 77aa: check NRS fairshare basic smoke (jobid default) ========================================================== 14:03:06 (1776880986)
ost.OSS.ost_io.nrs_policies=fairshare
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.143996 s, 117 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0467244 s, 22.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0556546 s, 18.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0767372 s, 13.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0780943 s, 13.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0903106 s, 11.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0785525 s, 13.3 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff965fc8c33000.lock_unused_count=2
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106058 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119383 s, 8.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101307 s, 10.4 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105325 s, 10.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134519 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124014 s, 8.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117555 s, 8.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108916 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111073 s, 9.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105349 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222879 s, 47.0 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199848 s, 52.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180498 s, 58.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055087 s, 190 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184917 s, 56.7 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289901 s, 36.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147393 s, 71.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298792 s, 35.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145373 s, 72.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258219 s, 40.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127845 s, 82.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171187 s, 61.3 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316848 s, 33.1 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff965fc8c33000.lock_unused_count=1
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218359 s, 48.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197325 s, 53.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111909 s, 93.7 MB/s
removed '/mnt/lustre/d77aa.sanityn/nrs_r_oleg339-client.virtnet'
removed '/mnt/lustre/d77aa.sanityn/nrs_w_oleg339-client.virtnet'
removed directory '/mnt/lustre/d77aa.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77aa (5s)

== sanityn test 77ab: check NRS fairshare mode switching and tunables ========================================================== 14:03:10 (1776880990)
ost.OSS.ost_io.nrs_policies=fairshare nid_fair
ost.OSS.ost_io.nrs_fairshare_opp_threshold=32
ost.OSS.ost_io.nrs_fairshare_opp_threshold=8
ost.OSS.ost_io.nrs_fairshare_delta_ms=250
oleg339-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_delta_ms=999999: Numerical result out of range
oleg339-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_delta_ms'='999999': Numerical result out of range
pdsh@oleg339-client: oleg339-server: ssh exited with exit code 34
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
oleg339-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=fairshare bogus_mode: Invalid argument
oleg339-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='fairshare bogus_mode': Invalid argument
pdsh@oleg339-client: oleg339-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ab (7s)

== sanityn test 77ac: check NRS fairshare rule parse / start / change / stop ========================================================== 14:03:17 (1776880997)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start r1 uid={500} rate=100
ost.OSS.ost_io.nrs_fairshare_rule=start r2 uid={501,502} rate=500 minrate=10
oleg339-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=start r1 uid={503} rate=1: File exists
oleg339-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='start r1 uid={503} rate=1': File exists
pdsh@oleg339-client: oleg339-server: ssh exited with exit code 17
ost.OSS.ost_io.nrs_fairshare_rule=change r1 rate=200
oleg339-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=change nope rate=1: No such file or directory
oleg339-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='change nope rate=1': No such file or directory
pdsh@oleg339-client: oleg339-server: ssh exited with exit code 2
oleg339-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_fairshare_rule=garbage r1 rate=1: Invalid argument
oleg339-server: error: set_param: setting 'ost/OSS/ost_io/nrs_fairshare_rule'='garbage r1 rate=1': Invalid argument
pdsh@oleg339-client: oleg339-server: ssh exited with exit code 22
ost.OSS.ost_io.nrs_fairshare_rule=stop r1
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ac (8s)

== sanityn test 77ad: check NRS fairshare rate ceiling dispatches under load ========================================================== 14:03:25 (1776881005)
ost.OSS.ost_io.nrs_policies=fairshare uid_fair
ost.OSS.ost_io.nrs_fairshare_rule=start rcap uid={0} rate=25600
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.137132 s, 122 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0638002 s, 16.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573054 s, 18.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0733148 s, 14.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0799782 s, 13.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0859836 s, 12.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588224 s, 17.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105672 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0847662 s, 12.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.096327 s, 10.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148019 s, 7.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158359 s, 6.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156086 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129464 s, 8.1 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170848 s, 6.1 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164863 s, 6.4 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff965fc8c33000.lock_unused_count=5
ldlm.namespaces.lustre-OST0001-osc-ffff965fc8c33000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180509 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246768 s, 42.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036215 s, 29.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313499 s, 33.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321004 s, 32.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341623 s, 30.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321 s, 32.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302749 s, 34.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348438 s, 30.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355604 s, 29.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344402 s, 30.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03697 s, 28.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380951 s, 27.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0406222 s, 25.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042202 s, 24.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0510737 s, 20.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053794 s, 19.5 MB/s
removed '/mnt/lustre/d77ad.sanityn/nrs_w_oleg339-client.virtnet'
removed '/mnt/lustre/d77ad.sanityn/nrs_r_oleg339-client.virtnet'
removed directory '/mnt/lustre/d77ad.sanityn'
ost.OSS.ost_io.nrs_fairshare_rule=stop
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ad (5s)

== sanityn test 77ae: check NRS fairshare composite (A_then_B) mode ========================================================== 14:03:30 (1776881010)
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
ost.OSS.ost_io.nrs_policies=fairshare uid_then_jobid_fair
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.169735 s, 98.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0441173 s, 23.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284338 s, 36.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130464 s, 8.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142466 s, 7.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131666 s, 8.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154032 s, 6.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137089 s, 7.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149937 s, 7.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165254 s, 6.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157122 s, 6.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134056 s, 7.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180792 s, 5.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178649 s, 5.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169269 s, 6.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152997 s, 6.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151222 s, 6.9 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272923 s, 38.4 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277802 s, 37.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272407 s, 38.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154966 s, 67.7 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318467 s, 32.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173717 s, 60.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207114 s, 50.6 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff965fc8c33000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364089 s, 28.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0380104 s, 27.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0347929 s, 30.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327702 s, 32.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164691 s, 63.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107521 s, 97.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128146 s, 81.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269785 s, 38.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253824 s, 41.3 MB/s
removed '/mnt/lustre/d77ae.sanityn/nrs_w_oleg339-client.virtnet'
removed '/mnt/lustre/d77ae.sanityn/nrs_r_oleg339-client.virtnet'
removed directory '/mnt/lustre/d77ae.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ae (5s)

== sanityn test 77af: check NRS fairshare delta kthread and delta_ms round-trip ========================================================== 14:03:36 (1776881016)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
ost.OSS.ost_io.nrs_fairshare_delta_ms=100
ost.OSS.ost_io.nrs_fairshare_delta_ms=1000
ost.OSS.ost_io.nrs_fairshare_delta_ms=10
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.133548 s, 126 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0370134 s, 28.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420473 s, 24.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0662624 s, 15.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0775819 s, 13.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0910121 s, 11.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0928712 s, 11.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10248 s, 10.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.088785 s, 11.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115501 s, 9.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0936567 s, 11.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107488 s, 9.8 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0940045 s, 11.2 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984586 s, 10.6 MB/s
ldlm.namespaces.lustre-OST0001-osc-ffff965fc8c33000.lock_unused_count=6
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0920141 s, 11.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0872412 s, 12.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113952 s, 9.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168299 s, 62.3 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020106 s, 52.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215678 s, 48.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215924 s, 48.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018979 s, 55.2 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188675 s, 55.6 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127964 s, 81.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941801 s, 111 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246186 s, 42.6 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219296 s, 47.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116819 s, 89.8 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00506494 s, 207 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140912 s, 74.4 MB/s

ldlm.namespaces.lustre-OST0000-osc-ffff965fc8c33000.lock_unused_count=1
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00401947 s, 261 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257401 s, 40.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745869 s, 141 MB/s
removed '/mnt/lustre/d77af.sanityn/nrs_w_oleg339-client.virtnet'
removed '/mnt/lustre/d77af.sanityn/nrs_r_oleg339-client.virtnet'
removed directory '/mnt/lustre/d77af.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77af (6s)

== sanityn test 77ag: check NRS fairshare locality tunable and BRW ordering ========================================================== 14:03:42 (1776881022)
ost.OSS.ost_io.nrs_policies=fairshare
ost.OSS.ost_io.nrs_fairshare_locality=off
ost.OSS.ost_io.nrs_fairshare_locality=on
ost.OSS.ost_io.nrs_fairshare_locality=auto
ost.OSS.ost_io.nrs_fairshare_locality=on
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.154137 s, 109 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447578 s, 23.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0723993 s, 14.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0705671 s, 14.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852338 s, 12.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0754844 s, 13.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.073744 s, 14.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069624 s, 15.1 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106359 s, 9.9 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109 s, 9.6 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0997841 s, 10.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0940064 s, 11.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0923489 s, 11.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102364 s, 10.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107504 s, 9.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105147 s, 10.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103458 s, 10.1 MB/s
ldlm.namespaces.lustre-OST0000-osc-ffff965fc8c33000.lock_unused_count=1
ldlm.namespaces.lustre-OST0001-osc-ffff965fc8c33000.lock_unused_count=1
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0171813 s, 61.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140655 s, 74.5 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971461 s, 108 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145844 s, 71.9 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207868 s, 50.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168315 s, 62.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01237 s, 84.8 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192657 s, 54.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193527 s, 54.2 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219814 s, 47.7 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00273739 s, 383 MB/s
1+0 records in
1+0 records out
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255791 s, 41.0 MB/s
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240819 s, 43.5 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00419909 s, 250 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00423921 s, 247 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623652 s, 168 MB/s
removed '/mnt/lustre/d77ag.sanityn/nrs_r_oleg339-client.virtnet'
removed '/mnt/lustre/d77ag.sanityn/nrs_w_oleg339-client.virtnet'
removed directory '/mnt/lustre/d77ag.sanityn'
ost.OSS.ost_io.nrs_policies=fifo
PASS 77ag (7s)

== sanityn test 77ah: verify NRS fairshare minrate floor under congestion ========================================================== 14:03:49 (1776881029)

 SKIP: sanityn test_77ah need OSTs and MDTs on separate nodes
SKIP 77ah (1s)
cleanup: ======================================================
== sanityn test complete, duration 63 sec ================ 14:03:50 (1776881030)
=== sanityn: start cleanup 14:03:51 (1776881031) ===
Stopping clients: oleg339-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg339-client.virtnet /mnt/lustre2 opts:
=== sanityn: finish cleanup 14:03:52 (1776881032) ===