-----============= acceptance-small: sanityn ============----- Mon Sep 7 19:04:15 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg257-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 40a skipping tests SLOW=no: 33a === sanityn: start setup 19:04:36 (1788822276) === Starting client oleg257-client.virtnet: -o user_xattr,flock 192.168.202.157@tcp:/lustre /mnt/lustre2 Mount client oleg257-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.202.157@tcp:/lustre /mnt/lustre2 Started clients oleg257-client.virtnet: 192.168.202.157@tcp:/lustre on /mnt/lustre2 type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) oleg257-client.virtnet: executing check_config_client /mnt/lustre oleg257-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg257-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff987710477800.idle_timeout=debug osc.lustre-OST0000-osc-ffff987720f5f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff987710477800.idle_timeout=debug osc.lustre-OST0001-osc-ffff987720f5f800.idle_timeout=debug disable quota as required oleg257-server: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanityn: finish setup 19:05:13 (1788822313) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340472 s, 30.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7499] == sanityn test 77ve: mClock: rule Reserved and Limit rate setting ========================================================== 19:05:18 (1788822318) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=50: Numerical result out of range oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} resvd_rate=100 limit_rate=50': Numerical result out of range pdsh@oleg257-client: oleg257-server: ssh exited with exit code 34 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} iops=100 Rule rate: limit_iops 100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} rate=5MiB/s Rule rate: limit_bps 5 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_rate=300MiB/s Rule rate: limit_bps 300 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 limit_rate=300 Rule rate: iops 100-300 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB Rule rate: bps 10-30 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10MiB limit_rate=30MiB resvd_iops=5 limit_iops=25 Rule rate: iops 5-25 bps 10-30 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} bps=5MiB/s Rule rate: limit_bps 5 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=10MiB/s ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=100 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: proj100 projid={100}, limit_iops 100, seq 9, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 Rule rate: limit_iops 100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=10 limit_rate=300 ost.OSS.ost_io.nrs_mclock_rule=change proj100 limit_rate=200 Rule rate: iops 10-200 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=2 limit_rate=unlimit ost.OSS.ost_io.nrs_mclock_rule=change proj100 rate=5 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: proj100 projid={100}, iops 2-5, seq 11, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: proj100 projid={100}, iops 2-5, seq 11, type=projid, ref 0 default *, limit_iops 10000, seq 1, type=projid, ref 0 not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5, bs: 1048576 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.8718 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 vs. 5 Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.8498 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 vs. 5 cleanup_tbf /mnt/lustre/d77ve.sanityn Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=5000B/s Rule rate: limit_bps 5000B/s ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} limit_bps=1536KiB/s Rule rate: limit_bps 1572864B/s Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77ve (102s) == sanityn test 77vq: mClock: a limit and weight policy needs no reservation ========================================================== 19:07:00 (1788822420) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start lw100 projid={100} limit_rate=100 weight=200 ost.OSS.ost_io.nrs_mclock_rule=start wonly projid={300} weight=300 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: wonly projid={300}, rate 0-max, weight 300, seq 3, type=projid, ref 0 lw100 projid={100}, limit_iops 100, weight 200, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: wonly projid={300}, rate 0-max, weight 300, seq 3, type=projid, ref 0 lw100 projid={100}, limit_iops 100, weight 200, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start res100 projid={200} resvd_rate=100: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start res100 projid={200} resvd_rate=100': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_mclock_rule=change lw100 limit_rate=20 not_under_control: 0 cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20, bs: 1048576 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.21632 s, 20.1 MB/s Write runtime is 6 s, speed is 16.666666 vs. 20 Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.59025 s, 18.8 MB/s Read runtime is 7 s, speed is 14.285714 vs. 20 cleanup_tbf /mnt/lustre/d77vq.sanityn Waiting for MDT destroys to complete Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop lw100 ost.OSS.ost_io.nrs_mclock_rule=stop wonly ost.OSS.ost_io.nrs_policies=fifo PASS 77vq (57s) == sanityn test 77vk: Setting unlimit limit rate and zero reserved rate for NRS rule ========================================================== 19:07:57 (1788822477) ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=100 L=300 W=100: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=100 L=300 W=100': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=max L=max: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=max L=max': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start proj100 projid={100} R=0 L=max: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start proj100 projid={100} R=0 L=max': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=0 L=100 Rule rate: iops 0-100 ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=20 L=unlimit Rule rate: iops 20-max ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=20MiB L=unlimit Rule rate: bps 20-max ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} R=0 L=max W=100 Rule rate: rate 0-max Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77vk (34s) == sanityn test 77vl: mClock: Verify R=0 and L=max works as expected ========================================================== 19:08:31 (1788822511) using SAVE_PROJECT_SUPPORTED=0 /usr/bin/fio /usr/bin/which: no jq in (/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:) SKIP: sanityn test_77vl jq is not installed removed '/tmp/tmp.KhDCeN8XTA' removed '/tmp/tmp.5e9hC8uZN2' SKIP 77vl (7s) == sanityn test 77vs: mClock: an unlimited class waits for no other throttle ========================================================== 19:08:38 (1788822518) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid limit=1 weight=1 ost.OSS.ost_io.nrs_mclock_rule=start slow projid={100} limit_rate=1 weight=100 ost.OSS.ost_io.nrs_mclock_rule=start fast projid={200} limit_rate=max weight=100 ost.OSS.ost_io.nrs_mclock_rule= regular_requests: CPT 0: fast projid={200}, rate 0-max, weight 100, seq 3, type=projid, ref 0 slow projid={100}, limit_iops 1, weight 100, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 high_priority_requests: CPT 0: fast projid={200}, rate 0-max, weight 100, seq 3, type=projid, ref 0 slow projid={100}, limit_iops 1, weight 100, seq 2, type=projid, ref 0 default *, limit_iops 10000, weight 100, seq 1, type=projid, ref 0 30+0 records in 30+0 records out 31457280 bytes (31 MB, 30 MiB) copied, 1.4825 s, 21.2 MB/s the unlimited class needed 2s for 30 writes Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop slow ost.OSS.ost_io.nrs_mclock_rule=stop fast ost.OSS.ost_io.nrs_policies=fifo PASS 77vs (28s) == sanityn test 77vo: TBF: an unlimited rate is not a valid TBF rate ========================================================== 19:09:06 (1788822546) ost.OSS.ost_io.nrs_policies=tbf nid oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} rate=max: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} rate=max': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} rate=unlimit: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} rate=unlimit': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_tbf_rule=start nidall nid={0@lo} limit_rate=max: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_tbf_rule'='start nidall nid={0@lo} limit_rate=max': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 ost.OSS.ost_io.nrs_tbf_rule=start nidall nid={0@lo} rate=100 ost.OSS.ost_io.nrs_tbf_rule= regular_requests: CPT 0: nidall nid={0@lo} 100, seq 2, type=nid, ref 0 default * 10000, seq 1, type=nid, ref 0 high_priority_requests: CPT 0: nidall nid={0@lo} 100, seq 2, type=nid, ref 0 default * 10000, seq 1, type=nid, ref 0 Cleanup TBF ost.OSS.ost_io.nrs_tbf_rule=stop nidall ost.OSS.ost_io.nrs_policies=fifo PASS 77vo (21s) == sanityn test 77vp: mClock: a zero reservation needs a second dimension ========================================================== 19:09:27 (1788822567) using SAVE_PROJECT_SUPPORTED=0 ost.OSS.ost_io.nrs_policies=mclock projid reserve=1 ost.OSS.ost_io.nrs_mclock_rule=start proj100 projid={100} resvd_rate=100 oleg257-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_mclock_rule=start zero projid={200} resvd_rate=0: Invalid argument oleg257-server: error: set_param: setting 'ost/OSS/ost_io/nrs_mclock_rule'='start zero projid={200} resvd_rate=0': Invalid argument pdsh@oleg257-client: oleg257-server: ssh exited with exit code 22 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.703626 s, 23.8 MB/s 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.601718 s, 27.9 MB/s Cleanup TBF ost.OSS.ost_io.nrs_mclock_rule=stop proj100 ost.OSS.ost_io.nrs_policies=fifo PASS 77vp (23s) cleanup: ====================================================== == sanityn test complete, duration 338 sec =============== 19:09:54 (1788822594) === sanityn: start cleanup 19:09:56 (1788822596) === Stopping clients: oleg257-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg257-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 19:10:04 (1788822604) ===