== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 17:15:17 (1715202917) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Wed May 8 17:15:18 EDT 2024 waiting for dbench pid 11234 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 421 29.73 MB/sec warmup 1 sec latency 17.433 ms 2 791 21.46 MB/sec warmup 2 sec latency 68.322 ms 2 1170 15.34 MB/sec warmup 3 sec latency 35.396 ms 2 1735 13.14 MB/sec warmup 4 sec latency 37.328 ms 2 2208 10.70 MB/sec warmup 5 sec latency 43.710 ms 2 2768 10.65 MB/sec warmup 6 sec latency 48.331 ms 2 3402 10.19 MB/sec warmup 7 sec latency 52.272 ms 2 3946 10.01 MB/sec warmup 8 sec latency 15.955 ms 2 4304 8.98 MB/sec warmup 9 sec latency 52.243 ms Running lustre_rsync 2 4695 8.42 MB/sec warmup 10 sec latency 58.242 ms 2 5244 8.24 MB/sec warmup 11 sec latency 43.331 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 1796 2 6537 11.51 MB/sec execute 1 sec latency 43.387 ms 2 7312 12.00 MB/sec execute 2 sec latency 37.514 ms 2 7778 8.34 MB/sec execute 3 sec latency 13.321 ms 2 8094 6.63 MB/sec execute 4 sec latency 55.092 ms 2 8763 7.03 MB/sec execute 5 sec latency 31.873 ms 11234 11235 11236 Running lustre_rsync 2 9458 6.42 MB/sec execute 6 sec latency 32.367 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 17500 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1849 2 10124 7.11 MB/sec execute 7 sec latency 35.888 ms 2 10926 7.78 MB/sec execute 8 sec latency 24.640 ms 2 11372 7.04 MB/sec execute 9 sec latency 62.243 ms 2 11749 6.68 MB/sec execute 10 sec latency 36.496 ms 2 12348 6.67 MB/sec execute 11 sec latency 33.543 ms 11234 11235 11236 Running lustre_rsync 2 13010 6.40 MB/sec execute 12 sec latency 32.110 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 19348 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1497 2 13660 6.77 MB/sec execute 13 sec latency 38.501 ms 2 14440 7.18 MB/sec execute 14 sec latency 27.648 ms 2 14872 6.77 MB/sec execute 15 sec latency 37.809 ms 2 15122 6.42 MB/sec execute 16 sec latency 70.154 ms 2 15781 6.56 MB/sec execute 17 sec latency 35.079 ms 11234 11235 11236 Running lustre_rsync 2 16381 6.26 MB/sec execute 18 sec latency 30.119 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 20844 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1433 2 17099 6.59 MB/sec execute 19 sec latency 40.160 ms 2 17951 6.94 MB/sec execute 20 sec latency 33.745 ms 2 18447 6.66 MB/sec execute 21 sec latency 57.148 ms 2 18879 6.52 MB/sec execute 22 sec latency 41.759 ms 2 19434 6.52 MB/sec execute 23 sec latency 45.653 ms 11234 11235 11236 Running lustre_rsync 2 19988 6.29 MB/sec execute 24 sec latency 36.500 ms 2 20748 6.58 MB/sec execute 25 sec latency 43.823 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 22276 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1597 2 21570 6.81 MB/sec execute 26 sec latency 29.340 ms 2 22013 6.60 MB/sec execute 27 sec latency 61.809 ms 2 22410 6.49 MB/sec execute 28 sec latency 39.427 ms 2 22995 6.49 MB/sec execute 29 sec latency 42.188 ms 2 23567 6.31 MB/sec execute 30 sec latency 37.456 ms 11234 11235 11236 Running lustre_rsync 2 24292 6.54 MB/sec execute 31 sec latency 40.615 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 23872 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1462 2 25053 6.69 MB/sec execute 32 sec latency 31.641 ms 2 25523 6.55 MB/sec execute 33 sec latency 13.460 ms 2 25854 6.40 MB/sec execute 34 sec latency 63.911 ms 2 26469 6.47 MB/sec execute 35 sec latency 43.400 ms 2 27051 6.32 MB/sec execute 36 sec latency 35.942 ms 11234 11235 11236 Running lustre_rsync 2 27793 6.51 MB/sec execute 37 sec latency 38.447 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 25333 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1490 2 28589 6.63 MB/sec execute 38 sec latency 46.347 ms 2 29101 6.53 MB/sec execute 39 sec latency 37.614 ms 2 29524 6.45 MB/sec execute 40 sec latency 61.590 ms 2 30202 6.46 MB/sec execute 41 sec latency 32.218 ms 2 30885 6.42 MB/sec execute 42 sec latency 32.976 ms 11234 11235 11236 Running lustre_rsync 2 31813 6.59 MB/sec execute 43 sec latency 35.306 ms 2 32391 6.64 MB/sec execute 44 sec latency 10.819 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 26822 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1635 2 32777 6.52 MB/sec execute 45 sec latency 65.677 ms 2 33351 6.58 MB/sec execute 46 sec latency 43.704 ms 2 33854 6.45 MB/sec execute 47 sec latency 31.941 ms 2 34712 6.55 MB/sec execute 48 sec latency 33.575 ms 2 35766 6.73 MB/sec execute 49 sec latency 26.254 ms 11234 11235 11236 Running lustre_rsync 2 36288 6.63 MB/sec execute 50 sec latency 49.126 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 28456 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1858 2 37001 6.68 MB/sec execute 51 sec latency 31.582 ms 2 37769 6.58 MB/sec execute 52 sec latency 25.836 ms 2 38701 6.74 MB/sec execute 53 sec latency 32.227 ms 2 39449 6.83 MB/sec execute 54 sec latency 28.191 ms 2 39939 6.73 MB/sec execute 55 sec latency 46.953 ms 11234 11235 11236 Running lustre_rsync 2 40671 6.77 MB/sec execute 56 sec latency 40.293 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 30313 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1782 2 41465 6.72 MB/sec execute 57 sec latency 26.268 ms 2 42597 6.96 MB/sec execute 58 sec latency 32.072 ms 2 43260 6.90 MB/sec execute 59 sec latency 8.726 ms 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 13030 4.474 25.191 Close 9508 0.987 4.996 Rename 558 6.149 12.087 Unlink 2688 1.806 5.572 Qpathinfo 11722 1.102 9.219 Qfileinfo 2048 0.118 1.469 Qfsinfo 2218 0.078 1.668 Sfileinfo 1068 2.873 6.374 Find 4596 0.339 7.343 WriteX 6464 0.666 7.636 ReadX 20664 0.012 0.549 LockX 44 0.883 2.725 UnlockX 44 0.890 1.809 Flush 934 22.395 70.141 Throughput 6.90366 MB/sec 2 clients 2 procs max_latency=70.154 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Wed May 8 17:16:31 EDT 2024 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 32094 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1421 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found