== lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 15:36:56 (1746128216) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:37:02 EDT 2025 waiting for dbench pid 13347 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 154 13.04 MB/sec warmup 1 sec latency 87.931 ms 2 263 9.90 MB/sec warmup 2 sec latency 95.162 ms 2 381 9.03 MB/sec warmup 3 sec latency 72.070 ms 2 513 8.85 MB/sec warmup 4 sec latency 52.906 ms 2 710 8.47 MB/sec warmup 5 sec latency 53.032 ms 2 812 7.15 MB/sec warmup 6 sec latency 51.983 ms 2 949 6.22 MB/sec warmup 7 sec latency 48.514 ms 2 1097 5.73 MB/sec warmup 8 sec latency 43.906 ms Running lustre_rsync 2 1214 5.12 MB/sec warmup 9 sec latency 77.868 ms 2 1378 5.19 MB/sec warmup 10 sec latency 81.118 ms 2 1498 4.73 MB/sec warmup 11 sec latency 89.084 ms 2 1811 0.25 MB/sec execute 1 sec latency 52.027 ms 2 1976 0.24 MB/sec execute 2 sec latency 51.762 ms 2 2138 0.31 MB/sec execute 3 sec latency 50.946 ms 2 2316 0.79 MB/sec execute 4 sec latency 40.394 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 8 seconds Changelog records consumed: 492 2 2431 0.76 MB/sec execute 5 sec latency 52.090 ms 2 2609 0.93 MB/sec execute 6 sec latency 51.648 ms 2 2931 2.08 MB/sec execute 7 sec latency 41.230 ms 2 3241 2.10 MB/sec execute 8 sec latency 42.968 ms 2 3553 2.71 MB/sec execute 9 sec latency 41.556 ms 13347 13350 13351 Running lustre_rsync 2 3702 2.51 MB/sec execute 10 sec latency 42.007 ms 2 3840 2.46 MB/sec execute 11 sec latency 41.019 ms 2 3951 2.31 MB/sec execute 12 sec latency 47.437 ms 2 4047 2.13 MB/sec execute 13 sec latency 54.444 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5217 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 844 2 4219 1.99 MB/sec execute 14 sec latency 41.402 ms 2 4345 1.90 MB/sec execute 15 sec latency 63.102 ms 2 4471 1.82 MB/sec execute 16 sec latency 47.913 ms 2 4608 1.86 MB/sec execute 17 sec latency 51.565 ms 2 4755 1.77 MB/sec execute 18 sec latency 42.332 ms 13347 13350 13351 Running lustre_rsync 2 4957 1.99 MB/sec execute 19 sec latency 48.328 ms 2 5076 1.90 MB/sec execute 20 sec latency 39.982 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6060 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 605 2 5193 1.82 MB/sec execute 21 sec latency 55.309 ms 2 5337 1.74 MB/sec execute 22 sec latency 41.711 ms 2 5409 1.67 MB/sec execute 23 sec latency 113.692 ms 2 5549 1.61 MB/sec execute 24 sec latency 123.042 ms 2 5658 1.56 MB/sec execute 25 sec latency 64.945 ms 13347 13350 13351 Running lustre_rsync 2 5784 1.51 MB/sec execute 26 sec latency 43.570 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 6664 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 402 2 5948 1.55 MB/sec execute 27 sec latency 51.091 ms 2 6115 1.56 MB/sec execute 28 sec latency 43.580 ms 2 6333 1.71 MB/sec execute 29 sec latency 57.036 ms 2 6571 1.76 MB/sec execute 30 sec latency 46.596 ms 2 6926 1.83 MB/sec execute 31 sec latency 53.974 ms 13347 13350 13351 Running lustre_rsync 2 7138 1.96 MB/sec execute 32 sec latency 39.619 ms 2 7256 1.92 MB/sec execute 33 sec latency 46.159 ms 2 7398 1.92 MB/sec execute 34 sec latency 42.696 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7065 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 405 2 7517 1.88 MB/sec execute 35 sec latency 38.542 ms 2 7629 1.83 MB/sec execute 36 sec latency 45.108 ms 2 7808 1.79 MB/sec execute 37 sec latency 45.581 ms 2 7960 1.77 MB/sec execute 38 sec latency 36.675 ms 2 8084 1.74 MB/sec execute 39 sec latency 67.311 ms 13347 13350 13351 Running lustre_rsync 2 8273 1.75 MB/sec execute 40 sec latency 38.116 ms 2 8517 1.85 MB/sec execute 41 sec latency 36.285 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 7469 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 601 2 8661 1.81 MB/sec execute 42 sec latency 53.648 ms 2 8794 1.78 MB/sec execute 43 sec latency 42.021 ms 2 8908 1.74 MB/sec execute 44 sec latency 42.114 ms 2 9109 1.71 MB/sec execute 45 sec latency 38.442 ms 2 9262 1.68 MB/sec execute 46 sec latency 45.655 ms 13347 13350 13351 Running lustre_rsync 2 9462 1.70 MB/sec execute 47 sec latency 44.920 ms 2 9582 1.70 MB/sec execute 48 sec latency 49.602 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8069 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 498 2 9850 1.79 MB/sec execute 49 sec latency 53.081 ms 2 10051 1.82 MB/sec execute 50 sec latency 68.904 ms 2 10292 1.81 MB/sec execute 51 sec latency 58.372 ms 2 10497 1.83 MB/sec execute 52 sec latency 59.134 ms 2 10696 1.91 MB/sec execute 53 sec latency 52.964 ms 13347 13350 13351 Running lustre_rsync 2 10808 1.88 MB/sec execute 54 sec latency 47.269 ms 2 10924 1.88 MB/sec execute 55 sec latency 81.651 ms 2 11025 1.86 MB/sec execute 56 sec latency 43.499 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8566 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 368 2 11133 1.83 MB/sec execute 57 sec latency 63.814 ms 2 11245 1.80 MB/sec execute 58 sec latency 45.688 ms 2 11379 1.78 MB/sec execute 59 sec latency 76.439 ms 2 cleanup 60 sec 0 cleanup 61 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 3379 20.037 123.019 Close 2471 4.517 47.405 Rename 140 30.248 68.881 Unlink 712 7.310 37.492 Qpathinfo 3116 4.805 90.609 Qfileinfo 533 0.298 12.391 Qfsinfo 573 0.367 18.715 Sfileinfo 250 18.549 41.550 Find 1190 0.964 28.729 WriteX 1658 2.851 94.887 ReadX 5346 0.031 3.357 LockX 12 8.613 21.676 UnlockX 12 6.510 17.351 Flush 240 22.151 76.423 Throughput 1.77602 MB/sec 2 clients 2 procs max_latency=123.042 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Thu May 1 15:38:15 EDT 2025 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory: 'clients/client1/~dmtmp/COREL' removed directory: 'clients/client1/~dmtmp/SEED' removed directory: 'clients/client1/~dmtmp/ACCESS' removed directory: 'clients/client1/~dmtmp/PARADOX' removed directory: 'clients/client1/~dmtmp/WORD' removed directory: 'clients/client1/~dmtmp/WORDPRO' removed directory: 'clients/client1/~dmtmp/EXCEL' removed directory: 'clients/client1/~dmtmp/PM' removed directory: 'clients/client1/~dmtmp/PWRPNT' removed directory: 'clients/client1/~dmtmp' removed directory: 'clients/client1' removed directory: 'clients/client0/~dmtmp/COREL' removed directory: 'clients/client0/~dmtmp/SEED' removed directory: 'clients/client0/~dmtmp/ACCESS' removed directory: 'clients/client0/~dmtmp/PARADOX' removed directory: 'clients/client0/~dmtmp/WORD' removed directory: 'clients/client0/~dmtmp/WORDPRO' removed directory: 'clients/client0/~dmtmp/EXCEL' removed directory: 'clients/client0/~dmtmp/PM' removed directory: 'clients/client0/~dmtmp/PWRPNT' removed directory: 'clients/client0/~dmtmp' removed directory: 'clients/client0' removed directory: 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Target: /tmp/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 8933 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 583 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0001: changelog user 'cl4' not found lustre-MDT0000: changelog user 'cl4' not found