== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 15:47:22 (1746128842) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:47:26 EDT 2025 waiting for dbench pid 12170 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 147 12.53 MB/sec warmup 1 sec latency 74.010 ms 2 264 9.91 MB/sec warmup 2 sec latency 65.279 ms 2 393 9.29 MB/sec warmup 3 sec latency 53.208 ms 2 516 8.91 MB/sec warmup 4 sec latency 50.824 ms 2 681 8.46 MB/sec warmup 5 sec latency 127.972 ms 2 763 7.11 MB/sec warmup 6 sec latency 121.045 ms 2 847 6.16 MB/sec warmup 7 sec latency 134.795 ms 2 920 5.44 MB/sec warmup 8 sec latency 111.261 ms Running lustre_rsync 2 1060 5.08 MB/sec warmup 9 sec latency 127.532 ms 2 1199 4.60 MB/sec warmup 10 sec latency 45.064 ms 2 1411 4.72 MB/sec warmup 11 sec latency 49.267 ms 2 1633 0.24 MB/sec execute 1 sec latency 196.950 ms 2 1703 0.18 MB/sec execute 2 sec latency 203.331 ms 2 1828 0.19 MB/sec execute 3 sec latency 104.304 ms 2 1940 0.20 MB/sec execute 4 sec latency 100.935 ms 2 2030 0.21 MB/sec execute 5 sec latency 83.857 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 9 seconds Changelog records consumed: 428 2 2172 0.23 MB/sec execute 6 sec latency 43.827 ms 2 2347 0.53 MB/sec execute 7 sec latency 136.903 ms 2 2428 0.51 MB/sec execute 8 sec latency 128.139 ms 2 2567 0.63 MB/sec execute 9 sec latency 140.483 ms 2 2775 1.18 MB/sec execute 10 sec latency 151.998 ms 12170 12173 12174 Running lustre_rsync 2 2977 1.35 MB/sec execute 11 sec latency 186.183 ms 2 3176 1.34 MB/sec execute 12 sec latency 211.147 ms 2 3317 1.43 MB/sec execute 13 sec latency 221.410 ms 2 3525 1.76 MB/sec execute 14 sec latency 143.672 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4458 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 707 2 3678 1.69 MB/sec execute 15 sec latency 45.673 ms 2 3803 1.71 MB/sec execute 16 sec latency 58.838 ms 2 3919 1.65 MB/sec execute 17 sec latency 43.487 ms 2 3987 1.56 MB/sec execute 18 sec latency 88.909 ms 2 4059 1.47 MB/sec execute 19 sec latency 126.357 ms 12170 12173 12174 Running lustre_rsync 2 4175 1.40 MB/sec execute 20 sec latency 56.318 ms 2 4246 1.36 MB/sec execute 21 sec latency 250.325 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5164 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 499 2 4301 1.31 MB/sec execute 22 sec latency 218.821 ms 2 4366 1.26 MB/sec execute 23 sec latency 174.740 ms 2 4452 1.23 MB/sec execute 24 sec latency 134.179 ms 2 4521 1.19 MB/sec execute 25 sec latency 211.643 ms 2 4580 1.19 MB/sec execute 26 sec latency 244.797 ms 12170 12173 12174 Running lustre_rsync 2 4709 1.19 MB/sec execute 27 sec latency 65.922 ms 2 4820 1.15 MB/sec execute 28 sec latency 50.631 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5662 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 288 2 4993 1.32 MB/sec execute 29 sec latency 57.592 ms 2 5083 1.28 MB/sec execute 30 sec latency 173.321 ms 2 5177 1.24 MB/sec execute 31 sec latency 49.943 ms 2 5262 1.20 MB/sec execute 32 sec latency 246.146 ms 2 5350 1.17 MB/sec execute 33 sec latency 67.355 ms 12170 12173 12174 Running lustre_rsync 2 5434 1.14 MB/sec execute 34 sec latency 50.965 ms 2 5540 1.11 MB/sec execute 35 sec latency 217.274 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5949 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 284 2 5650 1.09 MB/sec execute 36 sec latency 53.767 ms 2 5783 1.07 MB/sec execute 37 sec latency 41.272 ms 2 5936 1.11 MB/sec execute 38 sec latency 153.520 ms 2 6020 1.10 MB/sec execute 39 sec latency 150.487 ms 2 6165 1.10 MB/sec execute 40 sec latency 130.060 ms 12170 12173 12174 Running lustre_rsync 2 6435 1.23 MB/sec execute 41 sec latency 144.220 ms 2 6543 1.27 MB/sec execute 42 sec latency 166.495 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6232 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 327 2 6828 1.32 MB/sec execute 43 sec latency 115.816 ms 2 7072 1.43 MB/sec execute 44 sec latency 83.624 ms 2 7215 1.41 MB/sec execute 45 sec latency 45.255 ms 2 7351 1.43 MB/sec execute 46 sec latency 50.111 ms 2 7454 1.41 MB/sec execute 47 sec latency 47.446 ms 12170 12173 12174 Running lustre_rsync 2 7522 1.38 MB/sec execute 48 sec latency 75.564 ms 2 7587 1.35 MB/sec execute 49 sec latency 69.542 ms 2 7672 1.33 MB/sec execute 50 sec latency 47.347 ms 2 7779 1.31 MB/sec execute 51 sec latency 276.248 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6558 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 444 2 7835 1.29 MB/sec execute 52 sec latency 307.197 ms 2 7902 1.27 MB/sec execute 53 sec latency 111.420 ms 2 7985 1.25 MB/sec execute 54 sec latency 124.641 ms 2 8074 1.24 MB/sec execute 55 sec latency 125.053 ms 2 8172 1.25 MB/sec execute 56 sec latency 138.101 ms 12170 12173 12174 Running lustre_rsync 2 8288 1.23 MB/sec execute 57 sec latency 44.620 ms 2 8381 1.22 MB/sec execute 58 sec latency 46.169 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7001 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 360 2 8566 1.29 MB/sec execute 59 sec latency 57.401 ms 2 cleanup 60 sec 2 cleanup 61 sec 0 cleanup 61 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 2470 24.139 126.335 Close 1826 5.950 36.188 Rename 104 34.291 114.338 Unlink 500 9.771 40.565 Qpathinfo 2296 5.897 67.294 Qfileinfo 392 0.343 6.733 Qfsinfo 408 0.480 18.142 Sfileinfo 200 23.363 74.273 Find 866 1.240 65.338 WriteX 1224 2.876 30.357 ReadX 3859 0.044 4.279 LockX 8 9.012 13.769 UnlockX 8 6.476 8.286 Flush 172 101.892 307.183 Throughput 1.29439 MB/sec 2 clients 2 procs max_latency=307.197 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:48:39 EDT 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7360 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 332 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found