== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 18:49:15 (1736984955) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Wed Jan 15 18:49:18 EST 2025 waiting for dbench pid 11223 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 247 18.80 MB/sec warmup 1 sec latency 39.875 ms 2 446 15.64 MB/sec warmup 2 sec latency 48.486 ms 2 666 14.08 MB/sec warmup 3 sec latency 152.428 ms 2 789 10.71 MB/sec warmup 4 sec latency 85.083 ms 2 919 8.70 MB/sec warmup 5 sec latency 93.512 ms 2 1154 7.66 MB/sec warmup 6 sec latency 87.832 ms 2 1475 7.43 MB/sec warmup 7 sec latency 24.996 ms 2 1731 6.56 MB/sec warmup 8 sec latency 66.071 ms Running lustre_rsync 2 1982 5.87 MB/sec warmup 9 sec latency 86.970 ms 2 2240 5.35 MB/sec warmup 10 sec latency 26.511 ms 2 2434 5.11 MB/sec warmup 11 sec latency 91.268 ms 2 3016 3.17 MB/sec execute 1 sec latency 109.431 ms 2 3494 6.39 MB/sec execute 2 sec latency 65.064 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 5 seconds Changelog records consumed: 838 2 3744 4.93 MB/sec execute 3 sec latency 26.285 ms 2 3954 4.05 MB/sec execute 4 sec latency 29.467 ms 2 4239 3.33 MB/sec execute 5 sec latency 79.819 ms 2 4472 2.95 MB/sec execute 6 sec latency 59.671 ms 2 4950 3.76 MB/sec execute 7 sec latency 53.291 ms 11223 11224 11225 Running lustre_rsync 2 5264 3.35 MB/sec execute 8 sec latency 61.971 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5750 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1219 2 5752 3.09 MB/sec execute 9 sec latency 42.493 ms 2 6173 3.24 MB/sec execute 10 sec latency 47.135 ms 2 6745 3.89 MB/sec execute 11 sec latency 70.358 ms 2 7167 4.29 MB/sec execute 12 sec latency 74.747 ms 2 7413 4.14 MB/sec execute 13 sec latency 19.213 ms 11223 11224 11225 Running lustre_rsync 2 7612 3.89 MB/sec execute 14 sec latency 36.342 ms 2 7830 3.67 MB/sec execute 15 sec latency 96.604 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6968 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 998 2 7917 3.47 MB/sec execute 16 sec latency 116.337 ms 2 8048 3.30 MB/sec execute 17 sec latency 94.399 ms 2 8199 3.25 MB/sec execute 18 sec latency 99.908 ms 2 8359 3.09 MB/sec execute 19 sec latency 50.247 ms 2 8592 3.23 MB/sec execute 20 sec latency 91.753 ms 11223 11224 11225 Running lustre_rsync 2 8719 3.09 MB/sec execute 21 sec latency 82.451 ms 2 8883 2.96 MB/sec execute 22 sec latency 151.757 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7965 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 455 2 9022 2.85 MB/sec execute 23 sec latency 112.122 ms 2 9269 2.75 MB/sec execute 24 sec latency 30.635 ms 2 9526 2.75 MB/sec execute 25 sec latency 85.626 ms 2 9851 2.94 MB/sec execute 26 sec latency 102.984 ms 2 10110 2.95 MB/sec execute 27 sec latency 112.602 ms 11223 11224 11225 Running lustre_rsync 2 10655 3.19 MB/sec execute 28 sec latency 48.210 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8419 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 568 2 10961 3.17 MB/sec execute 29 sec latency 19.810 ms 2 11163 3.09 MB/sec execute 30 sec latency 25.710 ms 2 11351 3.00 MB/sec execute 31 sec latency 142.820 ms 2 11461 2.93 MB/sec execute 32 sec latency 91.880 ms 2 11643 2.87 MB/sec execute 33 sec latency 64.289 ms 11223 11224 11225 Running lustre_rsync 2 11872 2.85 MB/sec execute 34 sec latency 33.180 ms 2 12137 2.94 MB/sec execute 35 sec latency 46.666 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8986 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 709 2 12312 2.87 MB/sec execute 36 sec latency 90.758 ms 2 12538 2.80 MB/sec execute 37 sec latency 27.939 ms 2 12785 2.74 MB/sec execute 38 sec latency 92.903 ms 2 13030 2.74 MB/sec execute 39 sec latency 80.098 ms 2 13158 2.71 MB/sec execute 40 sec latency 109.369 ms 11223 11224 11225 Running lustre_rsync 2 13570 2.87 MB/sec execute 41 sec latency 106.129 ms 2 13847 2.84 MB/sec execute 42 sec latency 109.216 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 9694 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 633 2 14027 2.83 MB/sec execute 43 sec latency 114.129 ms 2 14287 2.91 MB/sec execute 44 sec latency 32.835 ms 2 14446 2.90 MB/sec execute 45 sec latency 51.622 ms 2 14547 2.85 MB/sec execute 46 sec latency 38.398 ms 2 14659 2.78 MB/sec execute 47 sec latency 48.415 ms 11223 11224 11225 Running lustre_rsync 2 14863 2.73 MB/sec execute 48 sec latency 54.001 ms 2 14936 2.69 MB/sec execute 49 sec latency 125.941 ms 2 15057 2.64 MB/sec execute 50 sec latency 110.657 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 10326 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 595 2 15158 2.60 MB/sec execute 51 sec latency 125.185 ms 2 15350 2.60 MB/sec execute 52 sec latency 95.819 ms 2 15607 2.66 MB/sec execute 53 sec latency 34.288 ms 2 15783 2.62 MB/sec execute 54 sec latency 86.322 ms 2 15924 2.57 MB/sec execute 55 sec latency 117.489 ms 11223 11224 11225 Running lustre_rsync 2 16067 2.53 MB/sec execute 56 sec latency 32.665 ms 2 16215 2.49 MB/sec execute 57 sec latency 111.289 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 10920 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 483 2 16400 2.46 MB/sec execute 58 sec latency 34.578 ms 2 16597 2.46 MB/sec execute 59 sec latency 104.316 ms 2 cleanup 60 sec 0 cleanup 61 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 4885 12.614 66.860 Close 3598 2.897 14.448 Rename 208 15.186 50.227 Unlink 990 4.477 19.339 Qpathinfo 4460 2.739 34.561 Qfileinfo 768 0.218 7.341 Qfsinfo 798 0.209 10.629 Sfileinfo 400 8.344 29.101 Find 1706 0.685 26.957 WriteX 2418 1.652 19.916 ReadX 7476 0.020 4.556 LockX 16 3.402 8.096 UnlockX 16 2.923 5.489 Flush 344 54.450 151.742 Throughput 2.45655 MB/sec 2 clients 2 procs max_latency=151.757 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Wed Jan 15 18:50:31 EST 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 11402 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 485 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found