== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 07:12:44 (1764936764) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Fri Dec 5 07:12:49 EST 2025 waiting for dbench pid 11293 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 121 10.99 MB/sec warmup 1 sec latency 97.990 ms 2 198 7.82 MB/sec warmup 2 sec latency 98.300 ms 2 288 7.12 MB/sec warmup 3 sec latency 143.309 ms 2 367 6.54 MB/sec warmup 4 sec latency 103.337 ms 2 445 6.25 MB/sec warmup 5 sec latency 108.112 ms 2 528 6.12 MB/sec warmup 6 sec latency 96.790 ms 2 667 6.03 MB/sec warmup 7 sec latency 170.723 ms Running lustre_rsync 2 725 5.32 MB/sec warmup 8 sec latency 120.241 ms 2 787 4.76 MB/sec warmup 9 sec latency 133.863 ms 2 866 4.31 MB/sec warmup 10 sec latency 212.424 ms 2 914 3.95 MB/sec warmup 11 sec latency 193.169 ms 2 1086 2.06 MB/sec execute 1 sec latency 231.558 ms 2 1178 1.11 MB/sec execute 2 sec latency 64.993 ms 2 1249 0.79 MB/sec execute 3 sec latency 60.367 ms 2 1438 2.06 MB/sec execute 4 sec latency 78.563 ms 2 1524 1.68 MB/sec execute 5 sec latency 197.783 ms 2 1633 1.42 MB/sec execute 6 sec latency 195.398 ms 2 1702 1.23 MB/sec execute 7 sec latency 204.228 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 12 seconds Changelog records consumed: 310 2 1779 1.10 MB/sec execute 8 sec latency 65.241 ms 2 1863 0.99 MB/sec execute 9 sec latency 62.209 ms 2 1956 0.91 MB/sec execute 10 sec latency 166.930 ms 2 2037 0.85 MB/sec execute 11 sec latency 69.862 ms 2 2160 0.80 MB/sec execute 12 sec latency 64.797 ms 11293 11294 11295 Running lustre_rsync 2 2251 0.75 MB/sec execute 13 sec latency 76.991 ms 2 2356 0.86 MB/sec execute 14 sec latency 294.689 ms 2 2405 0.81 MB/sec execute 15 sec latency 240.165 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3520 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 616 2 2477 0.85 MB/sec execute 16 sec latency 203.102 ms 2 2603 0.84 MB/sec execute 17 sec latency 163.971 ms 2 2887 1.17 MB/sec execute 18 sec latency 150.560 ms 2 2985 1.22 MB/sec execute 19 sec latency 159.474 ms 2 3190 1.23 MB/sec execute 20 sec latency 159.050 ms 11293 11294 11295 Running lustre_rsync 2 3317 1.28 MB/sec execute 21 sec latency 295.148 ms 2 3468 1.41 MB/sec execute 22 sec latency 118.903 ms 2 3622 1.45 MB/sec execute 23 sec latency 62.705 ms 2 3694 1.40 MB/sec execute 24 sec latency 63.179 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4135 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 286 2 3775 1.43 MB/sec execute 25 sec latency 144.802 ms 2 3830 1.37 MB/sec execute 26 sec latency 133.639 ms 2 3904 1.34 MB/sec execute 27 sec latency 92.953 ms 2 3975 1.30 MB/sec execute 28 sec latency 87.393 ms 2 4066 1.25 MB/sec execute 29 sec latency 64.406 ms 11293 11294 11295 Running lustre_rsync 2 4163 1.21 MB/sec execute 30 sec latency 47.057 ms 2 4236 1.18 MB/sec execute 31 sec latency 221.897 ms 2 4280 1.15 MB/sec execute 32 sec latency 243.596 ms 2 4303 1.12 MB/sec execute 33 sec latency 245.278 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4420 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 435 2 4363 1.10 MB/sec execute 34 sec latency 108.545 ms 2 4442 1.08 MB/sec execute 35 sec latency 124.318 ms 2 4489 1.05 MB/sec execute 36 sec latency 185.017 ms 2 4559 1.03 MB/sec execute 37 sec latency 137.279 ms 2 4692 1.06 MB/sec execute 38 sec latency 59.552 ms 11293 11294 11295 Running lustre_rsync 2 4761 1.04 MB/sec execute 39 sec latency 60.522 ms 2 4830 1.02 MB/sec execute 40 sec latency 74.715 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4854 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 270 2 4976 1.13 MB/sec execute 41 sec latency 76.710 ms 2 5052 1.11 MB/sec execute 42 sec latency 208.373 ms 2 5140 1.08 MB/sec execute 43 sec latency 53.886 ms 2 5218 1.06 MB/sec execute 44 sec latency 194.571 ms 2 5314 1.04 MB/sec execute 45 sec latency 92.925 ms 11293 11294 11295 Running lustre_rsync 2 5388 1.02 MB/sec execute 46 sec latency 62.819 ms 2 5451 1.00 MB/sec execute 47 sec latency 186.298 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5123 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 284 2 5562 0.99 MB/sec execute 48 sec latency 166.473 ms 2 5688 0.97 MB/sec execute 49 sec latency 63.610 ms 2 5796 0.96 MB/sec execute 50 sec latency 60.895 ms 2 5916 0.98 MB/sec execute 51 sec latency 201.762 ms 2 5977 0.97 MB/sec execute 52 sec latency 163.836 ms 2 6037 0.98 MB/sec execute 53 sec latency 179.114 ms 11293 11294 11295 Running lustre_rsync 2 6140 0.97 MB/sec execute 54 sec latency 231.745 ms 2 6324 1.06 MB/sec execute 55 sec latency 84.506 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5406 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 276 2 6484 1.09 MB/sec execute 56 sec latency 206.770 ms 2 6555 1.08 MB/sec execute 57 sec latency 167.738 ms 2 6752 1.08 MB/sec execute 58 sec latency 212.014 ms 2 6901 1.10 MB/sec execute 59 sec latency 157.250 ms 2 cleanup 60 sec 11293 11294 11295 Running lustre_rsync 2 cleanup 61 sec 2 cleanup 62 sec 0 cleanup 62 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 1956 30.591 144.778 Close 1500 7.980 118.015 Rename 88 38.306 84.484 Unlink 338 12.363 36.868 Qpathinfo 1921 7.201 80.522 Qfileinfo 360 0.432 28.343 Qfsinfo 330 0.549 18.483 Sfileinfo 167 25.038 57.536 Find 754 1.533 55.417 WriteX 1049 4.727 46.411 ReadX 3552 0.040 9.442 LockX 8 7.975 17.097 UnlockX 8 6.004 8.150 Flush 126 126.003 295.115 Throughput 1.10323 MB/sec 2 clients 2 procs max_latency=295.148 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Fri Dec 5 07:14:04 EST 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5681 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 242 removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5922 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 179 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found