== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 12:37:45 (1736357865) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Wed Jan 8 12:37:48 EST 2025 waiting for dbench pid 12357 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 522 36.11 MB/sec warmup 1 sec latency 11.800 ms 2 1169 23.01 MB/sec warmup 2 sec latency 10.253 ms 2 1804 17.55 MB/sec warmup 3 sec latency 11.681 ms 2 2387 13.98 MB/sec warmup 4 sec latency 14.916 ms 2 3012 13.41 MB/sec warmup 5 sec latency 13.712 ms 2 3782 13.25 MB/sec warmup 6 sec latency 17.367 ms 2 4120 11.45 MB/sec warmup 7 sec latency 14.735 ms 2 4540 10.23 MB/sec warmup 8 sec latency 19.293 ms 2 5131 10.05 MB/sec warmup 9 sec latency 13.386 ms Running lustre_rsync 2 5712 9.16 MB/sec warmup 10 sec latency 12.669 ms 2 6481 9.56 MB/sec warmup 11 sec latency 10.421 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 2188 2 7759 0.84 MB/sec execute 1 sec latency 13.216 ms 2 8196 2.29 MB/sec execute 2 sec latency 22.173 ms 2 8821 3.73 MB/sec execute 3 sec latency 17.843 ms 2 9485 3.66 MB/sec execute 4 sec latency 10.797 ms 2 10428 5.89 MB/sec execute 5 sec latency 11.339 ms 12357 12358 12359 Running lustre_rsync 2 11073 6.47 MB/sec execute 6 sec latency 10.741 ms 2 11708 6.10 MB/sec execute 7 sec latency 21.746 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 21450 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 2366 2 12413 6.19 MB/sec execute 8 sec latency 11.922 ms 2 13226 6.09 MB/sec execute 9 sec latency 8.330 ms 2 14399 7.65 MB/sec execute 10 sec latency 8.334 ms 2 14933 7.07 MB/sec execute 11 sec latency 13.937 ms 2 15612 7.27 MB/sec execute 12 sec latency 9.893 ms 12357 12358 12359 Running lustre_rsync 2 16334 6.81 MB/sec execute 13 sec latency 9.024 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 23815 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1782 2 17208 7.30 MB/sec execute 14 sec latency 8.920 ms 2 18115 7.69 MB/sec execute 15 sec latency 10.584 ms 2 18724 7.32 MB/sec execute 16 sec latency 12.041 ms 2 19439 7.40 MB/sec execute 17 sec latency 9.854 ms 2 20152 7.19 MB/sec execute 18 sec latency 9.351 ms 12357 12358 12359 Running lustre_rsync 2 21125 7.59 MB/sec execute 19 sec latency 9.885 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 25596 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1891 2 21744 7.68 MB/sec execute 20 sec latency 10.356 ms 2 22249 7.40 MB/sec execute 21 sec latency 18.233 ms 2 22883 7.45 MB/sec execute 22 sec latency 11.305 ms 2 23361 7.17 MB/sec execute 23 sec latency 41.491 ms 2 23938 7.08 MB/sec execute 24 sec latency 10.877 ms 12357 12358 12359 Running lustre_rsync 2 24983 7.57 MB/sec execute 25 sec latency 10.414 ms 2 25420 7.38 MB/sec execute 26 sec latency 12.210 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 27486 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1607 2 26030 7.26 MB/sec execute 27 sec latency 14.974 ms 2 26702 7.24 MB/sec execute 28 sec latency 10.013 ms 2 27329 7.11 MB/sec execute 29 sec latency 9.534 ms 2 28361 7.56 MB/sec execute 30 sec latency 12.390 ms 2 28814 7.42 MB/sec execute 31 sec latency 13.855 ms 12357 12358 12359 Running lustre_rsync 2 29322 7.24 MB/sec execute 32 sec latency 18.578 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 29092 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1832 2 29937 7.28 MB/sec execute 33 sec latency 12.645 ms 2 30581 7.11 MB/sec execute 34 sec latency 10.782 ms 2 31415 7.29 MB/sec execute 35 sec latency 11.082 ms 2 32277 7.44 MB/sec execute 36 sec latency 8.729 ms 2 32849 7.29 MB/sec execute 37 sec latency 17.497 ms 12357 12358 12359 Running lustre_rsync 2 33534 7.33 MB/sec execute 38 sec latency 9.917 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 30923 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1822 2 34311 7.24 MB/sec execute 39 sec latency 9.843 ms 2 35322 7.43 MB/sec execute 40 sec latency 8.664 ms 2 35946 7.48 MB/sec execute 41 sec latency 12.774 ms 2 36567 7.39 MB/sec execute 42 sec latency 24.957 ms 2 37236 7.38 MB/sec execute 43 sec latency 13.771 ms 12357 12358 12359 Running lustre_rsync 2 37926 7.29 MB/sec execute 44 sec latency 12.291 ms 2 39022 7.59 MB/sec execute 45 sec latency 10.571 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 32744 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1891 2 39529 7.50 MB/sec execute 46 sec latency 9.839 ms 2 40146 7.42 MB/sec execute 47 sec latency 22.740 ms 2 40832 7.41 MB/sec execute 48 sec latency 10.294 ms 2 41459 7.32 MB/sec execute 49 sec latency 14.491 ms 2 42382 7.47 MB/sec execute 50 sec latency 12.133 ms 12357 12358 12359 Running lustre_rsync 2 42941 7.51 MB/sec execute 51 sec latency 13.807 ms 2 43471 7.39 MB/sec execute 52 sec latency 14.487 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 34634 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1855 2 44108 7.42 MB/sec execute 53 sec latency 10.245 ms 2 44801 7.31 MB/sec execute 54 sec latency 10.872 ms 2 45804 7.45 MB/sec execute 55 sec latency 14.913 ms 2 46468 7.51 MB/sec execute 56 sec latency 10.456 ms 2 47031 7.42 MB/sec execute 57 sec latency 12.957 ms 12357 12358 12359 Running lustre_rsync 2 47713 7.44 MB/sec execute 58 sec latency 11.516 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 36488 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1880 2 48386 7.34 MB/sec execute 59 sec latency 9.528 ms 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 14572 4.590 41.479 Close 10686 0.947 3.709 Rename 614 6.775 16.285 Unlink 2944 1.737 4.544 Qpathinfo 13218 1.113 9.993 Qfileinfo 2304 0.120 1.732 Qfsinfo 2376 0.079 2.004 Sfileinfo 1200 3.181 10.487 Find 5042 0.333 9.956 WriteX 7154 0.880 7.637 ReadX 22748 0.012 1.181 LockX 48 0.885 1.297 UnlockX 48 0.862 1.548 Flush 1022 5.642 24.950 Throughput 7.33885 MB/sec 2 clients 2 procs max_latency=41.491 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Wed Jan 8 12:39:00 EST 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 38367 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 906 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0001: changelog user 'cl4' not found lustre-MDT0000: changelog user 'cl4' not found