== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 18:05:58 (1718316358) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Thu Jun 13 18:06:00 EDT 2024 waiting for dbench pid 11367 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 476 33.36 MB/sec warmup 1 sec latency 21.484 ms 2 980 21.90 MB/sec warmup 2 sec latency 53.502 ms 2 1766 17.52 MB/sec warmup 3 sec latency 26.210 ms 2 2485 14.36 MB/sec warmup 4 sec latency 35.679 ms 2 3636 15.45 MB/sec warmup 5 sec latency 25.088 ms 2 4236 13.42 MB/sec warmup 6 sec latency 26.168 ms 2 4565 11.74 MB/sec warmup 7 sec latency 53.729 ms 2 5358 11.36 MB/sec warmup 8 sec latency 24.857 ms 2 6044 10.63 MB/sec warmup 9 sec latency 32.732 ms Running lustre_rsync 2 7198 11.55 MB/sec warmup 10 sec latency 26.238 ms 2 7781 10.80 MB/sec warmup 11 sec latency 47.623 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 2574 2 8855 6.39 MB/sec execute 1 sec latency 54.099 ms 2 9581 5.63 MB/sec execute 2 sec latency 25.547 ms 2 10756 10.42 MB/sec execute 3 sec latency 30.688 ms 2 11333 8.60 MB/sec execute 4 sec latency 67.719 ms 2 11880 7.64 MB/sec execute 5 sec latency 23.555 ms 11367 11368 11369 Running lustre_rsync 2 12655 7.51 MB/sec execute 6 sec latency 52.059 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 20220 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 2251 2 13343 7.77 MB/sec execute 7 sec latency 43.436 ms 2 14399 8.95 MB/sec execute 8 sec latency 36.670 ms 2 14929 8.10 MB/sec execute 9 sec latency 42.247 ms 2 15476 7.66 MB/sec execute 10 sec latency 38.380 ms 2 16221 7.58 MB/sec execute 11 sec latency 39.770 ms 11367 11368 11369 Running lustre_rsync 2 17169 8.11 MB/sec execute 12 sec latency 32.773 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 22470 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1863 2 17943 8.45 MB/sec execute 13 sec latency 39.891 ms 2 18476 7.94 MB/sec execute 14 sec latency 57.164 ms 2 19001 7.65 MB/sec execute 15 sec latency 33.417 ms 2 19782 7.61 MB/sec execute 16 sec latency 29.508 ms 2 20706 7.98 MB/sec execute 17 sec latency 30.355 ms 11367 11368 11369 Running lustre_rsync 2 21671 8.26 MB/sec execute 18 sec latency 21.703 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 24332 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1697 2 22134 7.89 MB/sec execute 19 sec latency 47.631 ms 2 22812 7.95 MB/sec execute 20 sec latency 28.881 ms 2 23473 7.63 MB/sec execute 21 sec latency 35.258 ms 2 24324 7.91 MB/sec execute 22 sec latency 33.617 ms 2 25230 8.13 MB/sec execute 23 sec latency 20.262 ms 11367 11368 11369 Running lustre_rsync 2 25703 7.84 MB/sec execute 24 sec latency 54.030 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 26028 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1935 2 26439 7.89 MB/sec execute 25 sec latency 28.504 ms 2 27069 7.64 MB/sec execute 26 sec latency 27.124 ms 2 27882 7.86 MB/sec execute 27 sec latency 26.096 ms 2 28760 8.04 MB/sec execute 28 sec latency 28.523 ms 2 29226 7.80 MB/sec execute 29 sec latency 43.328 ms 11367 11368 11369 Running lustre_rsync 2 29919 7.85 MB/sec execute 30 sec latency 33.946 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 27962 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1644 2 30658 7.64 MB/sec execute 31 sec latency 29.712 ms 2 31659 7.90 MB/sec execute 32 sec latency 37.288 ms 2 32406 7.98 MB/sec execute 33 sec latency 18.642 ms 2 32941 7.80 MB/sec execute 34 sec latency 49.621 ms 2 33735 7.83 MB/sec execute 35 sec latency 32.370 ms 11367 11368 11369 Running lustre_rsync 2 34535 7.76 MB/sec execute 36 sec latency 29.311 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 29605 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1862 2 35546 8.07 MB/sec execute 37 sec latency 25.561 ms 2 36161 7.95 MB/sec execute 38 sec latency 8.408 ms 2 36650 7.84 MB/sec execute 39 sec latency 51.601 ms 2 37259 7.81 MB/sec execute 40 sec latency 35.608 ms 2 37645 7.64 MB/sec execute 41 sec latency 47.463 ms 11367 11368 11369 Running lustre_rsync 2 38380 7.72 MB/sec execute 42 sec latency 36.219 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 31466 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1511 2 39184 7.85 MB/sec execute 43 sec latency 22.388 ms 2 39505 7.73 MB/sec execute 44 sec latency 14.956 ms 2 39865 7.58 MB/sec execute 45 sec latency 76.719 ms 2 40491 7.61 MB/sec execute 46 sec latency 26.956 ms 2 40998 7.47 MB/sec execute 47 sec latency 63.130 ms 11367 11368 11369 Running lustre_rsync 2 41975 7.60 MB/sec execute 48 sec latency 33.015 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 32976 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1443 2 42810 7.71 MB/sec execute 49 sec latency 32.107 ms 2 43178 7.57 MB/sec execute 50 sec latency 15.363 ms 2 43602 7.45 MB/sec execute 51 sec latency 60.831 ms 2 44064 7.47 MB/sec execute 52 sec latency 15.777 ms 2 44391 7.34 MB/sec execute 53 sec latency 67.983 ms 11367 11368 11369 Running lustre_rsync 2 45052 7.27 MB/sec execute 54 sec latency 34.104 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 34418 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1396 2 46142 7.51 MB/sec execute 55 sec latency 29.624 ms 2 46532 7.44 MB/sec execute 56 sec latency 13.613 ms 2 46921 7.32 MB/sec execute 57 sec latency 84.286 ms 2 47349 7.25 MB/sec execute 58 sec latency 36.195 ms 2 47884 7.24 MB/sec execute 59 sec latency 37.996 ms 11367 11368 11369 Running lustre_rsync 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 13955 4.172 19.408 Close 10304 1.009 3.906 Rename 577 5.878 16.530 Unlink 2764 1.911 5.331 Qpathinfo 12695 1.114 11.639 Qfileinfo 2216 0.138 2.306 Qfsinfo 2262 0.078 1.712 Sfileinfo 1122 2.878 8.708 Find 4865 0.357 10.704 WriteX 6858 0.627 8.265 ReadX 21693 0.017 1.361 LockX 44 0.739 1.011 UnlockX 44 0.728 1.015 Flush 962 18.623 84.280 Throughput 7.23897 MB/sec 2 clients 2 procs max_latency=84.286 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Thu Jun 13 18:07:12 EDT 2024 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 35813 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1382 removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 37194 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 246 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found