== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 17:17:10 (1738966630) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Fri Feb 7 17:17:12 EST 2025 waiting for dbench pid 12101 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 654 42.13 MB/sec warmup 1 sec latency 15.367 ms 2 1145 22.99 MB/sec warmup 2 sec latency 57.578 ms 2 1805 17.55 MB/sec warmup 3 sec latency 23.987 ms 2 2477 14.36 MB/sec warmup 4 sec latency 25.763 ms 2 3590 15.37 MB/sec warmup 5 sec latency 26.658 ms 2 4162 13.36 MB/sec warmup 6 sec latency 9.460 ms 2 4665 12.02 MB/sec warmup 7 sec latency 34.988 ms 2 5309 11.35 MB/sec warmup 8 sec latency 25.331 ms 2 5976 10.49 MB/sec warmup 9 sec latency 29.538 ms Running lustre_rsync 2 6925 10.91 MB/sec warmup 10 sec latency 29.676 ms 2 7596 10.76 MB/sec warmup 11 sec latency 7.738 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 2544 2 8821 8.66 MB/sec execute 1 sec latency 45.351 ms 2 9512 6.12 MB/sec execute 2 sec latency 28.248 ms 2 10465 9.02 MB/sec execute 3 sec latency 24.039 ms 2 11107 9.08 MB/sec execute 4 sec latency 8.112 ms 2 11561 7.56 MB/sec execute 5 sec latency 44.640 ms 12101 12104 12105 Running lustre_rsync 2 12203 7.77 MB/sec execute 6 sec latency 29.671 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 18268 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 2185 2 12823 6.84 MB/sec execute 7 sec latency 27.389 ms 2 13638 7.68 MB/sec execute 8 sec latency 29.457 ms 2 14485 8.22 MB/sec execute 9 sec latency 27.995 ms 2 14967 7.54 MB/sec execute 10 sec latency 48.082 ms 2 15470 7.18 MB/sec execute 11 sec latency 33.050 ms 12101 12104 12105 Running lustre_rsync 2 16087 7.12 MB/sec execute 12 sec latency 31.111 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 20452 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1645 2 16686 6.93 MB/sec execute 13 sec latency 32.874 ms 2 17738 7.82 MB/sec execute 14 sec latency 28.123 ms 2 18253 7.52 MB/sec execute 15 sec latency 8.848 ms 2 18718 7.16 MB/sec execute 16 sec latency 43.949 ms 2 19359 7.25 MB/sec execute 17 sec latency 34.606 ms 12101 12104 12105 Running lustre_rsync 2 19957 6.92 MB/sec execute 18 sec latency 24.775 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 22096 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1625 2 20755 7.26 MB/sec execute 19 sec latency 32.758 ms 2 21600 7.53 MB/sec execute 20 sec latency 22.865 ms 2 22074 7.23 MB/sec execute 21 sec latency 41.413 ms 2 22598 7.07 MB/sec execute 22 sec latency 25.913 ms 2 23201 7.04 MB/sec execute 23 sec latency 34.010 ms 12101 12104 12105 Running lustre_rsync 2 23803 6.94 MB/sec execute 24 sec latency 39.388 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 23720 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1541 2 24870 7.44 MB/sec execute 25 sec latency 39.814 ms 2 25399 7.29 MB/sec execute 26 sec latency 8.467 ms 2 25843 7.08 MB/sec execute 27 sec latency 58.313 ms 2 26496 7.14 MB/sec execute 28 sec latency 22.306 ms 2 27087 6.93 MB/sec execute 29 sec latency 27.178 ms 12101 12104 12105 Running lustre_rsync 2 27869 7.15 MB/sec execute 30 sec latency 30.182 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 25260 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1579 2 28719 7.32 MB/sec execute 31 sec latency 24.005 ms 2 29200 7.14 MB/sec execute 32 sec latency 51.573 ms 2 29796 7.19 MB/sec execute 33 sec latency 35.293 ms 2 30320 7.01 MB/sec execute 34 sec latency 34.929 ms 2 30980 6.96 MB/sec execute 35 sec latency 25.423 ms 12101 12104 12105 Running lustre_rsync 2 31991 7.29 MB/sec execute 36 sec latency 26.971 ms 2 32501 7.19 MB/sec execute 37 sec latency 8.725 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 26838 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1588 2 32957 7.05 MB/sec execute 38 sec latency 43.487 ms 2 33623 7.09 MB/sec execute 39 sec latency 22.937 ms 2 34256 6.99 MB/sec execute 40 sec latency 32.160 ms 2 34992 7.10 MB/sec execute 41 sec latency 31.602 ms 2 35854 7.24 MB/sec execute 42 sec latency 27.435 ms 12101 12104 12105 Running lustre_rsync 2 36320 7.10 MB/sec execute 43 sec latency 60.670 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 28425 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1800 2 36974 7.14 MB/sec execute 44 sec latency 34.641 ms 2 37537 7.01 MB/sec execute 45 sec latency 24.953 ms 2 38400 7.13 MB/sec execute 46 sec latency 33.185 ms 2 39276 7.27 MB/sec execute 47 sec latency 20.706 ms 2 39781 7.14 MB/sec execute 48 sec latency 49.640 ms 12101 12104 12105 Running lustre_rsync 2 40291 7.07 MB/sec execute 49 sec latency 44.371 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 30224 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1649 2 40932 7.06 MB/sec execute 50 sec latency 23.520 ms 2 41561 7.02 MB/sec execute 51 sec latency 31.537 ms 2 42632 7.26 MB/sec execute 52 sec latency 22.522 ms 2 43198 7.18 MB/sec execute 53 sec latency 8.363 ms 2 43664 7.12 MB/sec execute 54 sec latency 52.481 ms 12101 12104 12105 Running lustre_rsync 2 44299 7.11 MB/sec execute 55 sec latency 30.524 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 31872 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1631 2 44959 7.04 MB/sec execute 56 sec latency 26.599 ms 2 45832 7.15 MB/sec execute 57 sec latency 32.343 ms 2 46543 7.22 MB/sec execute 58 sec latency 18.434 ms 2 47034 7.12 MB/sec execute 59 sec latency 58.209 ms 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 13676 4.331 21.834 Close 10060 0.917 4.017 Rename 584 6.942 16.263 Unlink 2750 1.761 4.443 Qpathinfo 12416 1.205 7.532 Qfileinfo 2164 0.138 1.272 Qfsinfo 2276 0.086 1.131 Sfileinfo 1132 3.932 10.152 Find 4788 0.351 6.621 WriteX 6762 0.627 5.743 ReadX 21496 0.017 0.327 LockX 44 0.814 1.019 UnlockX 44 0.872 2.133 Flush 948 16.786 60.655 Throughput 7.12259 MB/sec 2 clients 2 procs max_latency=60.670 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Fri Feb 7 17:18:24 EST 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test Running lustre_rsync removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 33502 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1655 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found