== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 15:02:47 (1746126167) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:02:52 EDT 2025 waiting for dbench pid 13284 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 154 13.06 MB/sec warmup 1 sec latency 67.323 ms 2 267 10.04 MB/sec warmup 2 sec latency 62.845 ms 2 385 9.12 MB/sec warmup 3 sec latency 58.615 ms 2 512 8.86 MB/sec warmup 4 sec latency 51.417 ms 2 693 8.47 MB/sec warmup 5 sec latency 59.343 ms 2 786 7.14 MB/sec warmup 6 sec latency 59.337 ms 2 889 6.19 MB/sec warmup 7 sec latency 56.189 ms 2 988 5.47 MB/sec warmup 8 sec latency 49.102 ms Running lustre_rsync 2 1133 5.11 MB/sec warmup 9 sec latency 59.659 ms 2 1231 4.61 MB/sec warmup 10 sec latency 59.468 ms 2 1460 4.73 MB/sec warmup 11 sec latency 44.682 ms 2 1720 0.19 MB/sec execute 1 sec latency 82.371 ms 2 1861 0.20 MB/sec execute 2 sec latency 75.144 ms 2 2009 0.24 MB/sec execute 3 sec latency 60.868 ms 2 2163 0.28 MB/sec execute 4 sec latency 46.557 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 8 seconds Changelog records consumed: 468 2 2378 0.72 MB/sec execute 5 sec latency 41.185 ms 2 2554 0.92 MB/sec execute 6 sec latency 40.968 ms 2 2897 1.90 MB/sec execute 7 sec latency 42.318 ms 2 3194 2.03 MB/sec execute 8 sec latency 44.158 ms 2 3536 2.71 MB/sec execute 9 sec latency 36.049 ms 13284 13287 13288 Running lustre_rsync 2 3707 2.52 MB/sec execute 10 sec latency 45.537 ms 2 3854 2.47 MB/sec execute 11 sec latency 51.559 ms 2 3972 2.32 MB/sec execute 12 sec latency 39.492 ms 2 4095 2.14 MB/sec execute 13 sec latency 52.635 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6301 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 899 2 4279 2.02 MB/sec execute 14 sec latency 30.180 ms 2 4386 1.92 MB/sec execute 15 sec latency 61.092 ms 2 4488 1.84 MB/sec execute 16 sec latency 60.002 ms 2 4649 1.87 MB/sec execute 17 sec latency 52.398 ms 2 4796 1.78 MB/sec execute 18 sec latency 43.392 ms 13284 13287 13288 Running lustre_rsync 2 4987 2.00 MB/sec execute 19 sec latency 67.314 ms 2 5126 1.91 MB/sec execute 20 sec latency 42.612 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7199 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 602 2 5254 1.83 MB/sec execute 21 sec latency 44.111 ms 2 5373 1.75 MB/sec execute 22 sec latency 48.882 ms 2 5559 1.69 MB/sec execute 23 sec latency 55.118 ms 2 5704 1.64 MB/sec execute 24 sec latency 113.721 ms 2 5958 1.67 MB/sec execute 25 sec latency 26.583 ms 13284 13287 13288 Running lustre_rsync 2 6178 1.70 MB/sec execute 26 sec latency 63.756 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7800 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 530 2 6655 1.98 MB/sec execute 27 sec latency 34.269 ms 2 7095 2.24 MB/sec execute 28 sec latency 31.161 ms 2 7261 2.19 MB/sec execute 29 sec latency 33.435 ms 2 7432 2.19 MB/sec execute 30 sec latency 34.055 ms 2 7583 2.13 MB/sec execute 31 sec latency 39.394 ms 13284 13287 13288 Running lustre_rsync 2 7823 2.08 MB/sec execute 32 sec latency 38.365 ms 2 7968 2.04 MB/sec execute 33 sec latency 63.927 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8329 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 651 2 8120 2.03 MB/sec execute 34 sec latency 41.182 ms 2 8350 2.01 MB/sec execute 35 sec latency 30.764 ms 2 8670 2.12 MB/sec execute 36 sec latency 25.411 ms 2 8881 2.07 MB/sec execute 37 sec latency 73.753 ms 2 9167 2.04 MB/sec execute 38 sec latency 25.230 ms 13284 13287 13288 Running lustre_rsync 2 9480 2.05 MB/sec execute 39 sec latency 23.762 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8979 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 689 2 9998 2.24 MB/sec execute 40 sec latency 19.956 ms 2 10466 2.32 MB/sec execute 41 sec latency 26.722 ms 2 10811 2.42 MB/sec execute 42 sec latency 24.715 ms 2 11095 2.42 MB/sec execute 43 sec latency 18.638 ms 2 11475 2.39 MB/sec execute 44 sec latency 21.467 ms 13284 13287 13288 Running lustre_rsync 2 11743 2.40 MB/sec execute 45 sec latency 25.299 ms 2 12111 2.49 MB/sec execute 46 sec latency 25.693 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 9667 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 889 2 12270 2.44 MB/sec execute 47 sec latency 33.728 ms 2 12453 2.40 MB/sec execute 48 sec latency 29.421 ms 2 12660 2.35 MB/sec execute 49 sec latency 39.576 ms 2 12860 2.32 MB/sec execute 50 sec latency 33.883 ms 2 13073 2.32 MB/sec execute 51 sec latency 42.096 ms 13284 13287 13288 Running lustre_rsync 2 13274 2.32 MB/sec execute 52 sec latency 41.480 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 10555 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 613 2 13663 2.44 MB/sec execute 53 sec latency 42.564 ms 2 14018 2.47 MB/sec execute 54 sec latency 64.166 ms 2 14280 2.54 MB/sec execute 55 sec latency 36.336 ms 2 14453 2.53 MB/sec execute 56 sec latency 38.140 ms 2 14621 2.50 MB/sec execute 57 sec latency 34.271 ms 13284 13287 13288 Running lustre_rsync 2 14766 2.46 MB/sec execute 58 sec latency 44.558 ms 2 14974 2.43 MB/sec execute 59 sec latency 63.995 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 11167 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 674 2 cleanup 60 sec 0 cleanup 61 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 4685 14.502 112.097 Close 3430 3.106 62.084 Rename 194 22.496 81.485 Unlink 966 5.187 44.532 Qpathinfo 4266 3.472 45.512 Qfileinfo 738 0.249 5.366 Qfsinfo 784 0.241 11.335 Sfileinfo 363 13.567 54.600 Find 1654 0.657 22.369 WriteX 2307 2.090 35.248 ReadX 7353 0.033 7.334 LockX 16 3.520 7.243 UnlockX 16 2.802 5.423 Flush 338 15.654 63.979 Throughput 2.42879 MB/sec 2 clients 2 procs max_latency=113.721 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:04:05 EDT 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 11840 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 285 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0001: changelog user 'cl4' not found lustre-MDT0000: changelog user 'cl4' not found