== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 16:55:52 (1715460952) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Sat May 11 16:55:54 EDT 2024 waiting for dbench pid 11221 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 543 38.20 MB/sec warmup 1 sec latency 16.372 ms 2 986 21.90 MB/sec warmup 2 sec latency 68.582 ms 2 1807 17.55 MB/sec warmup 3 sec latency 36.333 ms 2 2447 14.06 MB/sec warmup 4 sec latency 34.592 ms 2 3498 15.34 MB/sec warmup 5 sec latency 37.974 ms 2 4002 13.35 MB/sec warmup 6 sec latency 16.280 ms 2 4462 11.66 MB/sec warmup 7 sec latency 63.041 ms 2 5197 11.32 MB/sec warmup 8 sec latency 30.153 ms 2 5967 10.48 MB/sec warmup 9 sec latency 33.223 ms Running lustre_rsync 2 7078 11.50 MB/sec warmup 10 sec latency 37.943 ms 2 7767 10.78 MB/sec warmup 11 sec latency 9.181 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 2554 2 8968 6.73 MB/sec execute 1 sec latency 56.649 ms 2 9820 8.93 MB/sec execute 2 sec latency 33.341 ms 2 10851 11.18 MB/sec execute 3 sec latency 32.555 ms 2 11382 8.71 MB/sec execute 4 sec latency 55.078 ms 11221 11222 11223 Running lustre_rsync 2 11930 7.71 MB/sec execute 5 sec latency 42.710 ms 2 12768 7.60 MB/sec execute 6 sec latency 37.766 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 18952 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 2257 2 13555 8.27 MB/sec execute 7 sec latency 45.691 ms 2 14290 8.69 MB/sec execute 8 sec latency 52.092 ms 2 14642 8.04 MB/sec execute 9 sec latency 15.430 ms 2 15079 7.38 MB/sec execute 10 sec latency 62.700 ms 2 15771 7.52 MB/sec execute 11 sec latency 44.667 ms 11221 11222 11223 Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 21208 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1579 2 16564 7.19 MB/sec execute 12 sec latency 35.945 ms 2 17539 7.79 MB/sec execute 13 sec latency 31.124 ms 2 18221 7.90 MB/sec execute 14 sec latency 11.156 ms 2 18733 7.50 MB/sec execute 15 sec latency 45.162 ms 2 19545 7.59 MB/sec execute 16 sec latency 28.198 ms 11221 11222 11223 Running lustre_rsync 2 20340 7.45 MB/sec execute 17 sec latency 33.183 ms 2 21471 8.13 MB/sec execute 18 sec latency 29.376 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 22786 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1880 2 22046 7.87 MB/sec execute 19 sec latency 45.038 ms 2 22583 7.66 MB/sec execute 20 sec latency 32.325 ms 2 23334 7.62 MB/sec execute 21 sec latency 31.771 ms 2 24247 7.91 MB/sec execute 22 sec latency 32.036 ms 2 25183 8.11 MB/sec execute 23 sec latency 21.274 ms 11221 11222 11223 Running lustre_rsync 2 25682 7.84 MB/sec execute 24 sec latency 57.953 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 24665 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1914 2 26382 7.90 MB/sec execute 25 sec latency 41.286 ms 2 27149 7.68 MB/sec execute 26 sec latency 30.851 ms 2 28078 7.92 MB/sec execute 27 sec latency 37.782 ms 2 28831 8.05 MB/sec execute 28 sec latency 23.016 ms 2 29303 7.82 MB/sec execute 29 sec latency 56.195 ms 11221 11222 11223 Running lustre_rsync 2 30012 7.86 MB/sec execute 30 sec latency 38.557 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 26578 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1743 2 30805 7.73 MB/sec execute 31 sec latency 25.029 ms 2 31907 8.13 MB/sec execute 32 sec latency 28.448 ms 2 32536 7.99 MB/sec execute 33 sec latency 8.407 ms 2 33099 7.88 MB/sec execute 34 sec latency 55.352 ms 2 33854 7.84 MB/sec execute 35 sec latency 30.297 ms 11221 11222 11223 Running lustre_rsync 2 34840 7.95 MB/sec execute 36 sec latency 32.886 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 28320 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1951 2 35786 8.14 MB/sec execute 37 sec latency 31.127 ms 2 36318 7.97 MB/sec execute 38 sec latency 48.621 ms 2 37084 8.01 MB/sec execute 39 sec latency 30.386 ms 2 37876 7.90 MB/sec execute 40 sec latency 28.963 ms 2 38880 8.07 MB/sec execute 41 sec latency 32.016 ms 11221 11222 11223 Running lustre_rsync 2 39679 8.10 MB/sec execute 42 sec latency 8.205 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 30270 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1937 2 40191 8.01 MB/sec execute 43 sec latency 54.898 ms 2 40949 7.98 MB/sec execute 44 sec latency 30.961 ms 2 41944 8.08 MB/sec execute 45 sec latency 27.161 ms 2 42872 8.21 MB/sec execute 46 sec latency 31.414 ms 2 43391 8.07 MB/sec execute 47 sec latency 50.070 ms 11221 11222 11223 Running lustre_rsync 2 44116 8.10 MB/sec execute 48 sec latency 30.404 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 32206 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1899 2 44944 8.01 MB/sec execute 49 sec latency 28.327 ms 2 45897 8.14 MB/sec execute 50 sec latency 38.189 ms 2 46595 8.17 MB/sec execute 51 sec latency 22.742 ms 2 47071 8.04 MB/sec execute 52 sec latency 53.742 ms 2 47787 8.06 MB/sec execute 53 sec latency 32.285 ms 11221 11222 11223 Running lustre_rsync 2 48554 7.98 MB/sec execute 54 sec latency 32.647 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 34104 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1951 2 49686 8.21 MB/sec execute 55 sec latency 30.701 ms 2 50327 8.12 MB/sec execute 56 sec latency 8.290 ms 2 50841 8.05 MB/sec execute 57 sec latency 47.947 ms 2 51643 8.03 MB/sec execute 58 sec latency 35.201 ms 2 52581 8.11 MB/sec execute 59 sec latency 33.513 ms 11221 11222 11223 Running lustre_rsync 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 15576 3.722 16.798 Close 11488 0.821 7.922 Rename 664 5.351 13.344 Unlink 3094 1.531 8.798 Qpathinfo 14176 0.978 10.263 Qfileinfo 2496 0.102 1.245 Qfsinfo 2584 0.060 1.012 Sfileinfo 1254 2.365 5.058 Find 5482 0.275 6.479 WriteX 7728 0.564 7.418 ReadX 24794 0.009 0.776 LockX 52 0.771 1.493 UnlockX 52 0.758 1.151 Flush 1070 19.102 62.685 Throughput 8.11142 MB/sec 2 clients 2 procs max_latency=62.700 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Sat May 11 16:57:07 EDT 2024 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 36054 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 2029 Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 38082 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 51 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found