== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 21:19:43 (1723252783) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Fri Aug 9 21:19:45 EDT 2024 waiting for dbench pid 12558 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 382 27.12 MB/sec warmup 1 sec latency 22.852 ms 2 864 21.57 MB/sec warmup 2 sec latency 20.110 ms 2 1497 17.36 MB/sec warmup 3 sec latency 10.818 ms 2 2052 13.31 MB/sec warmup 4 sec latency 12.282 ms 2 2594 11.60 MB/sec warmup 5 sec latency 12.874 ms 2 3462 12.47 MB/sec warmup 6 sec latency 19.716 ms 2 3896 11.44 MB/sec warmup 7 sec latency 17.611 ms 2 4229 10.05 MB/sec warmup 8 sec latency 18.356 ms 2 4478 9.07 MB/sec warmup 9 sec latency 30.103 ms Running lustre_rsync 2 4783 8.43 MB/sec warmup 10 sec latency 32.848 ms 2 5126 8.22 MB/sec warmup 11 sec latency 19.946 ms 2 5730 0.79 MB/sec execute 1 sec latency 21.588 ms 2 6154 2.67 MB/sec execute 2 sec latency 21.527 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 1863 2 6928 6.08 MB/sec execute 3 sec latency 17.695 ms 2 7358 6.71 MB/sec execute 4 sec latency 16.936 ms 2 7615 5.50 MB/sec execute 5 sec latency 22.095 ms 2 7975 4.79 MB/sec execute 6 sec latency 24.590 ms 2 8353 4.53 MB/sec execute 7 sec latency 19.519 ms 12558 12559 12560 Running lustre_rsync 2 8768 4.75 MB/sec execute 8 sec latency 14.658 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 19802 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1560 2 9093 4.28 MB/sec execute 9 sec latency 18.250 ms 2 9490 4.15 MB/sec execute 10 sec latency 16.368 ms 2 10068 4.78 MB/sec execute 11 sec latency 18.634 ms 2 10679 5.20 MB/sec execute 12 sec latency 19.396 ms 2 11000 5.05 MB/sec execute 13 sec latency 18.825 ms 12558 12559 12560 Running lustre_rsync 2 11315 4.71 MB/sec execute 14 sec latency 19.418 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 21361 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1133 2 11720 4.64 MB/sec execute 15 sec latency 24.614 ms 2 12217 4.75 MB/sec execute 16 sec latency 12.037 ms 2 12520 4.50 MB/sec execute 17 sec latency 17.407 ms 2 13002 4.42 MB/sec execute 18 sec latency 15.563 ms 2 13954 4.98 MB/sec execute 19 sec latency 10.700 ms 12558 12559 12560 Running lustre_rsync 2 14507 5.17 MB/sec execute 20 sec latency 11.670 ms 2 14881 4.97 MB/sec execute 21 sec latency 23.801 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 22493 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1245 2 15164 4.80 MB/sec execute 22 sec latency 54.055 ms 2 15706 4.96 MB/sec execute 23 sec latency 12.700 ms 2 16346 4.81 MB/sec execute 24 sec latency 9.201 ms 2 17121 5.16 MB/sec execute 25 sec latency 11.304 ms 2 17898 5.37 MB/sec execute 26 sec latency 12.867 ms 12558 12559 12560 Running lustre_rsync 2 18246 5.27 MB/sec execute 27 sec latency 16.695 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 23737 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1427 2 18664 5.14 MB/sec execute 28 sec latency 23.724 ms 2 19260 5.25 MB/sec execute 29 sec latency 13.387 ms 2 19729 5.11 MB/sec execute 30 sec latency 13.679 ms 2 20214 5.05 MB/sec execute 31 sec latency 14.204 ms 2 21161 5.35 MB/sec execute 32 sec latency 11.389 ms 12558 12559 12560 Running lustre_rsync 2 21757 5.47 MB/sec execute 33 sec latency 9.766 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 25163 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1525 2 22324 5.37 MB/sec execute 34 sec latency 13.861 ms 2 23049 5.46 MB/sec execute 35 sec latency 15.173 ms 2 23762 5.41 MB/sec execute 36 sec latency 7.824 ms 2 24896 5.82 MB/sec execute 37 sec latency 10.676 ms 2 25362 5.76 MB/sec execute 38 sec latency 12.310 ms 12558 12559 12560 Running lustre_rsync 2 25960 5.71 MB/sec execute 39 sec latency 12.865 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 26687 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1741 2 26579 5.73 MB/sec execute 40 sec latency 12.137 ms 2 27203 5.67 MB/sec execute 41 sec latency 11.157 ms 2 28047 5.84 MB/sec execute 42 sec latency 15.821 ms 2 28715 5.96 MB/sec execute 43 sec latency 9.199 ms 2 29217 5.86 MB/sec execute 44 sec latency 17.933 ms 2 29720 5.82 MB/sec execute 45 sec latency 11.721 ms 12558 12559 12560 Running lustre_rsync 2 30280 5.82 MB/sec execute 46 sec latency 11.259 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 28427 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 1593 2 30873 5.77 MB/sec execute 47 sec latency 10.559 ms 2 31846 6.00 MB/sec execute 48 sec latency 13.017 ms 2 32373 6.02 MB/sec execute 49 sec latency 11.406 ms 2 32852 5.93 MB/sec execute 50 sec latency 20.955 ms 2 33267 5.89 MB/sec execute 51 sec latency 15.344 ms 12558 12559 12560 Running lustre_rsync 2 33643 5.88 MB/sec execute 52 sec latency 25.048 ms 2 34048 5.78 MB/sec execute 53 sec latency 14.992 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 30019 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1453 2 34559 5.77 MB/sec execute 54 sec latency 14.712 ms 2 35469 6.00 MB/sec execute 55 sec latency 15.255 ms 2 35841 5.95 MB/sec execute 56 sec latency 13.048 ms 2 36257 5.86 MB/sec execute 57 sec latency 16.514 ms 2 36650 5.82 MB/sec execute 58 sec latency 14.696 ms 12558 12559 12560 Running lustre_rsync 2 37092 5.83 MB/sec execute 59 sec latency 17.510 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 31471 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 1335 2 cleanup 60 sec 0 cleanup 60 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 11116 6.070 43.589 Close 8195 1.201 8.368 Rename 468 8.922 24.567 Unlink 2237 2.151 10.774 Qpathinfo 10113 1.523 14.419 Qfileinfo 1763 0.151 3.238 Qfsinfo 1836 0.104 3.139 Sfileinfo 900 5.462 47.500 Find 3890 0.423 12.819 WriteX 5482 0.931 14.352 ReadX 17370 0.019 1.068 LockX 36 1.203 2.869 UnlockX 36 1.078 1.978 Flush 780 6.769 54.042 Throughput 5.82773 MB/sec 2 clients 2 procs max_latency=54.055 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Fri Aug 9 21:20:58 EDT 2024 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 32805 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 477 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0001: changelog user 'cl4' not found lustre-MDT0000: changelog user 'cl4' not found