== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 15:26:34 (1746127594) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:26:37 EDT 2025 waiting for dbench pid 12141 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 172 14.06 MB/sec warmup 1 sec latency 56.189 ms 2 307 11.29 MB/sec warmup 2 sec latency 47.545 ms 2 427 10.02 MB/sec warmup 3 sec latency 55.235 ms 2 615 10.49 MB/sec warmup 4 sec latency 57.791 ms 2 708 8.48 MB/sec warmup 5 sec latency 161.622 ms 2 769 7.12 MB/sec warmup 6 sec latency 150.959 ms 2 863 6.16 MB/sec warmup 7 sec latency 159.889 ms 2 933 5.44 MB/sec warmup 8 sec latency 147.488 ms Running lustre_rsync 2 1071 5.09 MB/sec warmup 9 sec latency 92.296 ms 2 1209 4.61 MB/sec warmup 10 sec latency 56.908 ms 2 1425 4.73 MB/sec warmup 11 sec latency 57.909 ms 2 1686 0.24 MB/sec execute 1 sec latency 151.454 ms 2 1849 0.26 MB/sec execute 2 sec latency 44.716 ms 2 2008 0.28 MB/sec execute 3 sec latency 111.520 ms 2 2158 0.30 MB/sec execute 4 sec latency 52.875 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 8 seconds Changelog records consumed: 457 2 2346 0.72 MB/sec execute 5 sec latency 107.357 ms 2 2432 0.67 MB/sec execute 6 sec latency 121.265 ms 2 2583 0.82 MB/sec execute 7 sec latency 133.339 ms 2 2931 1.84 MB/sec execute 8 sec latency 102.174 ms 2 3189 1.81 MB/sec execute 9 sec latency 166.857 ms 12141 12144 12145 Running lustre_rsync 2 3364 1.87 MB/sec execute 10 sec latency 122.112 ms 2 3625 2.27 MB/sec execute 11 sec latency 37.768 ms 2 3784 2.28 MB/sec execute 12 sec latency 46.286 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4653 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 754 2 3911 2.15 MB/sec execute 13 sec latency 33.294 ms 2 4052 1.99 MB/sec execute 14 sec latency 40.895 ms 2 4231 1.88 MB/sec execute 15 sec latency 42.402 ms 2 4297 1.79 MB/sec execute 16 sec latency 161.949 ms 2 4374 1.70 MB/sec execute 17 sec latency 107.103 ms 12141 12144 12145 Running lustre_rsync 2 4469 1.63 MB/sec execute 18 sec latency 145.006 ms 2 4549 1.57 MB/sec execute 19 sec latency 183.334 ms 2 4707 1.60 MB/sec execute 20 sec latency 112.919 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5406 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 591 2 4807 1.53 MB/sec execute 21 sec latency 69.714 ms 2 5008 1.73 MB/sec execute 22 sec latency 70.070 ms 2 5125 1.66 MB/sec execute 23 sec latency 174.597 ms 2 5213 1.60 MB/sec execute 24 sec latency 150.425 ms 2 5345 1.54 MB/sec execute 25 sec latency 45.703 ms 12141 12144 12145 Running lustre_rsync 2 5407 1.49 MB/sec execute 26 sec latency 62.307 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5996 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 389 2 5547 1.44 MB/sec execute 27 sec latency 157.483 ms 2 5694 1.40 MB/sec execute 28 sec latency 43.597 ms 2 5838 1.40 MB/sec execute 29 sec latency 45.354 ms 2 5976 1.41 MB/sec execute 30 sec latency 119.686 ms 2 6087 1.41 MB/sec execute 31 sec latency 161.532 ms 12141 12144 12145 Running lustre_rsync 2 6433 1.57 MB/sec execute 32 sec latency 90.123 ms 2 6555 1.61 MB/sec execute 33 sec latency 166.199 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6384 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 353 2 6894 1.67 MB/sec execute 34 sec latency 99.864 ms 2 7127 1.80 MB/sec execute 35 sec latency 84.118 ms 2 7256 1.76 MB/sec execute 36 sec latency 49.789 ms 2 7403 1.77 MB/sec execute 37 sec latency 38.951 ms 2 7508 1.74 MB/sec execute 38 sec latency 63.425 ms 12141 12144 12145 Running lustre_rsync 2 7588 1.69 MB/sec execute 39 sec latency 64.072 ms 2 7707 1.65 MB/sec execute 40 sec latency 62.257 ms 2 7789 1.62 MB/sec execute 41 sec latency 189.158 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6736 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 479 2 7848 1.59 MB/sec execute 42 sec latency 160.647 ms 2 7919 1.56 MB/sec execute 43 sec latency 115.977 ms 2 8014 1.54 MB/sec execute 44 sec latency 143.501 ms 2 8091 1.51 MB/sec execute 45 sec latency 156.260 ms 2 8238 1.53 MB/sec execute 46 sec latency 110.379 ms 12141 12144 12145 Running lustre_rsync 2 8360 1.50 MB/sec execute 47 sec latency 64.405 ms 2 8559 1.59 MB/sec execute 48 sec latency 47.053 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7214 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 354 2 8671 1.56 MB/sec execute 49 sec latency 171.886 ms 2 8769 1.53 MB/sec execute 50 sec latency 106.629 ms 2 8890 1.51 MB/sec execute 51 sec latency 43.920 ms 2 8997 1.48 MB/sec execute 52 sec latency 91.925 ms 2 9164 1.46 MB/sec execute 53 sec latency 63.885 ms 12141 12144 12145 Running lustre_rsync 2 9293 1.44 MB/sec execute 54 sec latency 42.703 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7567 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 369 2 9453 1.45 MB/sec execute 55 sec latency 174.758 ms 2 9535 1.44 MB/sec execute 56 sec latency 164.950 ms 2 9682 1.44 MB/sec execute 57 sec latency 152.948 ms 2 9935 1.52 MB/sec execute 58 sec latency 196.471 ms 2 10099 1.55 MB/sec execute 59 sec latency 137.842 ms 12141 12144 12145 Running lustre_rsync 2 cleanup 60 sec 2 cleanup 61 sec 0 cleanup 62 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 2975 20.301 69.702 Close 2219 4.756 25.345 Rename 128 30.872 70.037 Unlink 553 7.671 25.903 Qpathinfo 2801 4.746 51.887 Qfileinfo 514 0.305 8.035 Qfsinfo 470 0.347 7.485 Sfileinfo 232 21.527 69.037 Find 1025 0.825 36.119 WriteX 1527 2.479 28.345 ReadX 4984 0.038 4.554 LockX 12 3.235 5.481 UnlockX 12 3.698 7.735 Flush 200 85.789 196.456 Throughput 1.54653 MB/sec 2 clients 2 procs max_latency=196.471 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:27:51 EDT 2025 with return code 0 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7935 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 330 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8264 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 203 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found