-----============= acceptance-small: dom-performance ============----- Wed Sep 24 12:55:03 EDT 2025 mgs: Rocky Linux release 8.10 (Green Obsidian) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 mds1: Rocky Linux release 8.10 (Green Obsidian) MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky ost1: Rocky Linux release 8.10 (Green Obsidian) OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky client: Rocky Linux release 8.10 (Green Obsidian) CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg305-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/dom-performance.*ex': No such file or directory excepting tests: === dom-performance: start setup 12:55:09 (1758732909) === oleg305-client.virtnet: executing check_config_client /mnt/lustre oleg305-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg305-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff94ce987d1000.idle_timeout=debug osc.lustre-OST0001-osc-ffff94ce987d1000.idle_timeout=debug disable quota as required oleg305-server: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === dom-performance: finish setup 12:55:21 (1758732921) === == dom-performance test smallio: Performance comparision: smallio ========================================================== 12:55:22 (1758732922) ##### SmallIO: DoM files ## createmany -o /mnt/lustre/dp_dom/file- 16384 ## 2025-09-24 12:55:23: START total: 16384 open/close in 34.57 seconds: 473.97 ops/second ----- MDC RPCs: 32778 ----- OSC RPCs: 8 ## statmany -s /mnt/lustre/dp_dom/file- 16384 81920 ## 2025-09-24 12:56:01: START total: 81920 stats in 25 seconds: 3276.800049 stats/second ----- MDC RPCs: 16282 ----- OSC RPCs: 8 ## smalliomany -w /mnt/lustre/dp_dom/file- 16384 300 ## 2025-09-24 12:56:27: START total: write 33758741 bytes in 41 seconds: 823383.93 bytes/second ----- MDC RPCs: 49254 ----- OSC RPCs: 8 ## smalliomany -a /mnt/lustre/dp_dom/file- 16384 300 ## 2025-09-24 12:57:13: START total: append 33758741 bytes in 122 seconds: 276710.99 bytes/second ----- MDC RPCs: 98497 ----- OSC RPCs: 16378 ## smalliomany -r /mnt/lustre/dp_dom/file- 16384 300 ## 2025-09-24 12:59:19: START total: read 33758741 bytes in 57 seconds: 592258.61 bytes/second ----- MDC RPCs: 32789 ----- OSC RPCs: 16378 ## unlinkmany /mnt/lustre/dp_dom/file- 16384 ## 2025-09-24 13:00:18: START total: 16384 unlinks in 36 seconds: 455.111115 unlinks/second ----- MDC RPCs: 32779 ----- OSC RPCs: 8 ##### SmallIO: DoM files + DNE ## createmany -o /mnt/lustre/dp_dne/file- 16384 ## 2025-09-24 13:00:56: START total: 16384 open/close in 34.74 seconds: 471.61 ops/second ----- MDC RPCs: 32772 ----- OSC RPCs: 8 ## statmany -s /mnt/lustre/dp_dne/file- 16384 81920 ## 2025-09-24 13:01:34: START total: 81920 stats in 24 seconds: 3413.333252 stats/second ----- MDC RPCs: 16292 ----- OSC RPCs: 8 ## smalliomany -w /mnt/lustre/dp_dne/file- 16384 300 ## 2025-09-24 13:01:59: START total: write 33758741 bytes in 38 seconds: 888387.92 bytes/second ----- MDC RPCs: 49256 ----- OSC RPCs: 8 ## smalliomany -a /mnt/lustre/dp_dne/file- 16384 300 ## 2025-09-24 13:02:42: START total: append 33758741 bytes in 135 seconds: 250064.75 bytes/second ----- MDC RPCs: 98388 ----- OSC RPCs: 16378 ## smalliomany -r /mnt/lustre/dp_dne/file- 16384 300 ## 2025-09-24 13:05:02: START total: read 33758741 bytes in 223 seconds: 151384.49 bytes/second ----- MDC RPCs: 32781 ----- OSC RPCs: 16379 ## unlinkmany /mnt/lustre/dp_dne/file- 16384 ## 2025-09-24 13:08:49: START total: 16384 unlinks in 178 seconds: 92.044945 unlinks/second ----- MDC RPCs: 32777 ----- OSC RPCs: 8 ##### SmallIO: OST files ## createmany -o /mnt/lustre/dp_norm/file- 16384 ## 2025-09-24 13:11:52: START total: 16384 open/close in 156.46 seconds: 104.72 ops/second ----- MDC RPCs: 32802 ----- OSC RPCs: 8 ## statmany -s /mnt/lustre/dp_norm/file- 16384 81920 ## 2025-09-24 13:14:33: START total: 81920 stats in 151 seconds: 542.516541 stats/second ----- MDC RPCs: 16303 ----- OSC RPCs: 32542 ## smalliomany -w /mnt/lustre/dp_norm/file- 16384 300 ## 2025-09-24 13:17:07: START total: write 33758741 bytes in 187 seconds: 180528.03 bytes/second ----- MDC RPCs: 32807 ----- OSC RPCs: 32891 ## smalliomany -a /mnt/lustre/dp_norm/file- 16384 300 ## 2025-09-24 13:20:17: START total: append 33758741 bytes in 208 seconds: 162301.64 bytes/second ----- MDC RPCs: 32811 ----- OSC RPCs: 65599 ## smalliomany -r /mnt/lustre/dp_norm/file- 16384 300 ## 2025-09-24 13:23:49: START total: read 33758741 bytes in 170 seconds: 198580.83 bytes/second ----- MDC RPCs: 32804 ----- OSC RPCs: 32756 ## unlinkmany /mnt/lustre/dp_norm/file- 16384 ## 2025-09-24 13:26:42: START total: 16384 unlinks in 83 seconds: 197.397583 unlinks/second ----- MDC RPCs: 32788 ----- OSC RPCs: 8 PASS smallio (1968s) == dom-performance test mdtest: Performance comparision: mdtest ========================================================== 13:28:10 (1758734890) ##### MDtest: DoM files SKIP: dom-performance test_mdtest Mdtest is not installed, skipping SKIP mdtest (3s) == dom-performance test IOR: Performance comparision: IOR ========================================================== 13:28:13 (1758734893) ##### IOR: DoM files SKIP: dom-performance test_IOR IOR is not installed, skipping SKIP IOR (3s) == dom-performance test dbench: Performance comparision: dbench ========================================================== 13:28:16 (1758734896) ##### Dbench: DoM files ## dbench -D /mnt/lustre/dp_dom 4 ## 2025-09-24 13:28:18: START dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 failed to create barrier semaphore 2 of 4 processes prepared for launch 0 sec 4 of 4 processes prepared for launch 0 sec releasing clients 4 cleanup 600 sec 0 cleanup 601 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 200326 6.677 51.227 Close 147227 1.373 10.713 Rename 8507 11.926 45.071 Unlink 40372 3.352 27.177 Qpathinfo 181884 1.908 31.349 Qfileinfo 31767 0.076 5.795 Qfsinfo 33322 0.047 4.765 Sfileinfo 16322 5.900 28.491 Find 70308 0.481 23.894 WriteX 99099 0.297 8.939 ReadX 315196 0.018 2.643 LockX 656 1.480 5.168 UnlockX 656 1.486 5.043 Flush 14008 6.919 31.457 Throughput 10.4008 MB/sec 4 clients 4 procs max_latency=51.238 ms ----- MDC RPCs: 1443742 ----- OSC RPCs: 290 ##### Dbench: DoM files + DNE dbench uses subdirs, skipping for DNE dir ##### Dbench: OST files ## dbench -D /mnt/lustre/dp_norm 4 ## 2025-09-24 13:40:50: START dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 3 of 4 processes prepared for launch 0 sec 4 of 4 processes prepared for launch 0 sec releasing clients 4 cleanup 600 sec 0 cleanup 600 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 225662 5.753 78.468 Close 165690 1.104 40.272 Rename 9566 9.090 57.973 Unlink 45625 2.361 27.175 Qpathinfo 204737 1.548 46.250 Qfileinfo 35686 0.096 4.049 Qfsinfo 37520 0.040 5.495 Sfileinfo 18384 7.516 95.133 Find 79102 0.436 44.130 WriteX 111486 0.768 31.829 ReadX 354059 0.016 4.340 LockX 736 1.152 14.468 UnlockX 736 1.178 9.475 Flush 15790 8.124 67.895 Throughput 11.7423 MB/sec 4 clients 4 procs max_latency=95.143 ms ----- MDC RPCs: 1520225 ----- OSC RPCs: 367747 PASS dbench (1478s) == dom-performance test fio: Performance comparision: FIO ========================================================== 13:52:54 (1758736374) ##### FIO: DoM files ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_dom --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randwrite --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 13:53:37: START WRITE: BW 30797KiB/sec, IOPS 3849, lat (15/8955/8970)usec ----- MDC RPCs: 65725 ----- OSC RPCs: 8 ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_dom --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randread --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 13:54:16: START READ : BW 46368KiB/sec, IOPS 5796, lat (16/10342/10358)usec ----- MDC RPCs: 89631 ----- OSC RPCs: 8 ##### FIO: DoM files + DNE ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_dne --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randwrite --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 13:55:35: START WRITE: BW 9239KiB/sec, IOPS 1154, lat (26/28931/28958)usec ----- MDC RPCs: 51935 ----- OSC RPCs: 8 ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_dne --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randread --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 13:57:40: START READ : BW 19176KiB/sec, IOPS 2397, lat (30/24047/24078)usec ----- MDC RPCs: 90744 ----- OSC RPCs: 8 ##### FIO: OST files ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_norm --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randwrite --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 13:59:48: START WRITE: BW 15903KiB/sec, IOPS 1987, lat (18/17052/17070)usec ----- MDC RPCs: 63708 ----- OSC RPCs: 18850 ## fio --name=smallio --ioengine=posixaio --minimal --iodepth=16 --directory=/mnt/lustre/dp_norm --nrfiles=128 --openfiles=10000 --numjobs=4 --filesize=64k --lockfile=readwrite --bs=8k --rw=randread --buffered=1 --bs_unaligned=1 --file_service_type=random --randrepeat=1 --norandommap --group_reporting=1 --loops=32 ## 2025-09-24 14:01:02: START READ : BW 43748KiB/sec, IOPS 5468, lat (19/10460/10480)usec ----- MDC RPCs: 6685 ----- OSC RPCs: 84812 PASS fio (532s) == dom-performance test compbench: Performance comparision: compilebench ========================================================== 14:01:46 (1758736906) ##### compbench: DoM files SKIP: dom-performance test_compbench Compilebench is not installed, skipping SKIP compbench (2s) == dom-performance test complete, duration 4004 sec ====== 14:01:48 (1758736908) === dom-performance: start cleanup 14:01:49 (1758736909) === === dom-performance: finish cleanup 14:01:50 (1758736910) ===