-----============= acceptance-small: sanityn ============----- Mon Sep 7 19:03:42 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg111-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 40a skipping tests SLOW=no: 33a === sanityn: start setup 19:04:02 (1788822242) === Starting client oleg111-client.virtnet: -o user_xattr,flock 192.168.201.111@tcp:/lustre /mnt/lustre2 Mount client oleg111-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.111@tcp:/lustre /mnt/lustre2 Started clients oleg111-client.virtnet: 192.168.201.111@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg111-client.virtnet: executing check_config_client /mnt/lustre oleg111-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg111-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9aba05072000.idle_timeout=debug osc.lustre-OST0000-osc-ffff9aba11803000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9aba05072000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9aba11803000.idle_timeout=debug disable quota as required oleg111-server: oleg111-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 19:04:40 (1788822280) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.070853 s, 14.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7501] == sanityn test 77ve: mClock: rule Reserved and Limit rate setting ========================================================== 19:04:45 (1788822285) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=50: Numerical result out of range oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} resvd_rate=100 limit_rate=50': Numerical result out of range pdsh@oleg111-client: oleg111-server: ssh exited with exit code 34 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} iops=100 Rule rate: limit_iops 100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} rate=5MiB/s Rule rate: limit_bps 5 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_rate=300MiB/s Rule rate: limit_bps 300 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=300 Rule rate: iops 100-300 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB Rule rate: bps 10-30 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB resvd_iops=5 limit_iops=25 Rule rate: iops 5-25 bps 10-30 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} bps=5MiB/s Rule rate: limit_bps 5 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=10MiB/s ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=100 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 Rule rate: limit_iops 100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10 limit_rate=300 ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=200 Rule rate: iops 10-200 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=2 limit_rate=unlimit ost.OSS.ost_io.nrs_mclock_rule=change proj100 rate=5 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: proj100 projid={100}, iops 2-5, seq 11, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: proj100 projid={100}, iops 2-5, seq 11, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5, bs: 1048576 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.8643 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 vs. 5 Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.8795 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 vs. 5 cleanup_tbf /mnt/lustre/d77ve.sanityn Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=5000B/s Rule rate: limit_bps 5000B/s ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=1536KiB/s Rule rate: limit_bps 1572864B/s Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77ve (107s) == sanityn test 77vq: mClock: a limit and weight policy needs no reservation ========================================================== 19:06:32 (1788822392) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start lw100 projid={100} limit_rate=100 weight=200 ost.OSS.ost_io.nrs_mclock_rule=start wonly projid={300} weight=300 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: wonly projid={300}, rate 0-max, weight 300, seq 3, type=projid, ref 0 lw100 projid={100}, limit_iops 100, weight 200, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: wonly projid={300}, rate 0-max, weight 300, seq 3, type=projid, ref 0 lw100 projid={100}, limit_iops 100, weight 200, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start res100 projid={200} resvd_rate=100: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start res100 projid={200} resvd_rate=100': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_mclock_rule=change lw100 limit_rate=20 not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20, bs: 1048576 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.47754 s, 19.1 MB/s Write runtime is 6 s, speed is 16.666666 vs. 20 Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 6.31656 s, 16.6 MB/s Read runtime is 8 s, speed is 12.500000 vs. 20 cleanup_tbf /mnt/lustre/d77vq.sanityn Waiting for MDT destroys to complete Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop lw100 ost.OSS.ost_io.nrs_mclock_rule=stop wonly ost.OSS.ost_io.nrs_policies=fifo PASS 77vq (60s) == sanityn test 77vk: Setting unlimit limit rate and zero reserved rate for NRS rule ========================================================== 19:07:32 (1788822452) ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=100 L=300 W=100: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=100 L=300 W=100': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=max L=max: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=max L=max': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=0 L=max: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=0 L=max': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=0 L=100 Rule rate: iops 0-100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=20 L=unlimit Rule rate: iops 20-max ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=20MiB L=unlimit Rule rate: bps 20-max ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=0 L=max W=100 Rule rate: rate 0-max Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77vk (28s) == sanityn test 77vl: mClock: Verify R=0 and L=max works as expected ========================================================== 19:08:00 (1788822480) using SAVE_PROJECT_SUPPORTED=0 /usr/bin/fio /usr/bin/which: no jq in (/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:) SKIP: sanityn test_77vl jq is not installed removed '/tmp/tmp.d1OSU10qLY' removed '/tmp/tmp.qutNVKDNQf' SKIP 77vl (7s) == sanityn test 77vs: mClock: an unlimited class waits for no other throttle ========================================================== 19:08:07 (1788822487) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start slow projid={100} limit_rate=1 weight=100 ost.OSS.ost_io.nrs_mclock_rule=start fast projid={200} limit_rate=max weight=100 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: fast projid={200}, rate 0-max, weight 100, seq 3, type=projid, ref 0 slow projid={100}, limit_iops 1, weight 100, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: fast projid={200}, rate 0-max, weight 100, seq 3, type=projid, ref 0 slow projid={100}, limit_iops 1, weight 100, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 30+0 records in 30+0 records out 31457280 bytes (31 MB, 30 MiB) copied, 1.39243 s, 22.6 MB/s the unlimited class needed 1s for 30 writes Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop slow ost.OSS.ost_io.nrs_mclock_rule=stop fast ost.OSS.ost_io.nrs_policies=fifo PASS 77vs (28s) == sanityn test 77vo: TBF: an unlimited rate is not a valid TBF rate ========================================================== 19:08:35 (1788822515) ost.OSS.ost_io.nrs_policies=tbf nid oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} rate=max: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} rate=max': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} rate=unlimit: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} rate=unlimit': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} limit_rate=max: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} limit_rate=max': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_tbf_rule=start nidall nid={0@lo} rate=100 ost.OSS.ost_io.nrs_tbf_rule= regular_requests: CPT 0: nidall nid={0@lo} 100, seq 2, type=nid, ref 0 default * 10000, seq 1, type=nid, ref 0 high_priority_requests: CPT 0: nidall nid={0@lo} 100, seq 2, type=nid, ref 0 default * 10000, seq 1, type=nid, ref 0 Cleanup TBF ost.OSS.ost_io.nrs_tbf_rule=stop nidall ost.OSS.ost_io.nrs_policies=fifo PASS 77vo (25s) == sanityn test 77vp: mClock: a zero reservation needs a second dimension ========================================================== 19:09:00 (1788822540) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 oleg111-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start zero projid={200} resvd_rate=0: Invalid argument oleg111-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start zero projid={200} resvd_rate=0': Invalid argument pdsh@oleg111-client: oleg111-server: ssh exited with exit code 22 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.952879 s, 17.6 MB/s 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.355745 s, 47.2 MB/s Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77vp (22s) cleanup: ====================================================== == sanityn test complete, duration 341 sec =============== 19:09:25 (1788822565) === sanityn: start cleanup 19:09:27 (1788822567) === Stopping clients: oleg111-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg111-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 19:09:33 (1788822573) ===