-----============= acceptance-small: lustre-rsync-test ============----- Mon Aug 17 02:15:31 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg133-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/lustre-rsync-test.*ex': No such file or directory excepting tests: 2b === lustre-rsync-test: start setup 02:15:51 (1786947351) === oleg133-client.virtnet: executing check_config_client /mnt/lustre oleg133-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg133-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff982c07d99000.idle_timeout=debug osc.lustre-OST0001-osc-ffff982c07d99000.idle_timeout=debug disable quota as required oleg133-server: oleg133-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === lustre-rsync-test: finish setup 02:16:40 (1786947400) === nobody:x:65534: == lustre-rsync-test test 1A: Simple Replication ========= 02:16:42 (1786947402) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl1 cl1' lustre-MDT0000: Registered changelog user cl1 Replication #1 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl1 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 26 Replication #2 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl1 Starting changelog record: 26 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 3 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 lustre-MDT0001: clear the changelog for cl1 of all records lustre-MDT0001: Deregistered changelog user #1 lustre-MDT0001: changelog user 'cl1' not found lustre-MDT0000: changelog user 'cl1' not found PASS 1A (27s) == lustre-rsync-test test 1a: Replicate create/delete operations in ROOT directory ========================================================== 02:17:09 (1786947429) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' lustre-MDT0000: Registered changelog user cl2 Replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 11 File: /mnt/target/root-dir Size: 0 Blocks: 0 IO Block: 4096 directory Device: 2bh/43d Inode: 47047 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-17 02:17:17.000000000 -0400 Modify: 2026-08-17 02:17:17.000000000 -0400 Change: 2026-08-17 02:17:18.517000000 -0400 Birth: - File: /mnt/target/root-file Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: 2bh/43d Inode: 47048 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-17 02:17:18.000000000 -0400 Modify: 2026-08-17 02:17:17.000000000 -0400 Change: 2026-08-17 02:17:18.572000000 -0400 Birth: - stat: cannot statx '/mnt/target/root-file2': No such file or directory File: /mnt/target/root-file3 Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: 2bh/43d Inode: 47049 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-08-17 02:17:18.000000000 -0400 Modify: 2026-08-17 02:17:18.000000000 -0400 Change: 2026-08-17 02:17:18.666000000 -0400 Birth: - stat: cannot statx '/mnt/target/root-dir1': No such file or directory stat: cannot statx '/mnt/target/root-file4': No such file or directory lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0001: changelog user 'cl2' not found lustre-MDT0000: changelog user 'cl2' not found PASS 1a (23s) == lustre-rsync-test test 2a: Replicate files created by dbench. ========================================================== 02:17:32 (1786947452) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl3 cl3' lustre-MDT0000: Registered changelog user cl3 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2a.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2a.lustre-rsync-test at Mon Aug 17 02:17:43 EDT 2026 waiting for dbench pid 12523 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs failed to create barrier semaphore 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 84 7.60 MB/sec warmup 1 sec latency 114.671 ms 2 168 6.93 MB/sec warmup 2 sec latency 118.396 ms 2 211 5.49 MB/sec warmup 3 sec latency 239.905 ms 2 280 5.22 MB/sec warmup 4 sec latency 119.618 ms 2 344 4.96 MB/sec warmup 5 sec latency 109.472 ms 2 405 4.78 MB/sec warmup 6 sec latency 118.128 ms 2 471 4.70 MB/sec warmup 7 sec latency 116.967 ms 2 556 4.81 MB/sec warmup 8 sec latency 102.797 ms 2 667 4.70 MB/sec warmup 9 sec latency 97.195 ms 2 729 4.26 MB/sec warmup 10 sec latency 73.434 ms 2 784 3.89 MB/sec warmup 11 sec latency 95.201 ms 2 912 0.22 MB/sec execute 1 sec latency 104.495 ms 2 976 0.24 MB/sec execute 2 sec latency 97.004 ms 2 1072 0.86 MB/sec execute 3 sec latency 80.107 ms 2 1151 0.69 MB/sec execute 4 sec latency 64.507 ms 2 1227 0.58 MB/sec execute 5 sec latency 77.363 ms 2 1383 1.46 MB/sec execute 6 sec latency 72.996 ms 2 1456 1.26 MB/sec execute 7 sec latency 66.332 ms 2 1531 1.12 MB/sec execute 8 sec latency 107.551 ms 2 1613 1.01 MB/sec execute 9 sec latency 98.046 ms 2 1674 0.92 MB/sec execute 10 sec latency 88.922 ms 2 1755 0.85 MB/sec execute 11 sec latency 114.050 ms 2 1835 0.79 MB/sec execute 12 sec latency 91.393 ms 2 1918 0.74 MB/sec execute 13 sec latency 78.489 ms 2 1992 0.69 MB/sec execute 14 sec latency 74.275 ms 2 2093 0.67 MB/sec execute 15 sec latency 92.695 ms 2 2165 0.64 MB/sec execute 16 sec latency 85.177 ms 2 2330 0.73 MB/sec execute 17 sec latency 84.782 ms 2 2386 0.70 MB/sec execute 18 sec latency 89.386 ms 2 2435 0.68 MB/sec execute 19 sec latency 103.171 ms 2 2557 0.73 MB/sec execute 20 sec latency 59.384 ms 2 2766 0.98 MB/sec execute 21 sec latency 64.243 ms 2 2930 1.08 MB/sec execute 22 sec latency 78.614 ms 2 3003 1.03 MB/sec execute 23 sec latency 157.172 ms 2 3201 1.05 MB/sec execute 24 sec latency 91.623 ms 2 3319 1.10 MB/sec execute 25 sec latency 144.745 ms 2 3446 1.17 MB/sec execute 26 sec latency 105.621 ms 2 3582 1.24 MB/sec execute 27 sec latency 68.596 ms 2 3673 1.22 MB/sec execute 28 sec latency 73.039 ms 2 3753 1.23 MB/sec execute 29 sec latency 84.513 ms 2 3832 1.21 MB/sec execute 30 sec latency 88.967 ms 2 3905 1.19 MB/sec execute 31 sec latency 92.330 ms 2 3975 1.15 MB/sec execute 32 sec latency 69.280 ms 2 4067 1.12 MB/sec execute 33 sec latency 57.150 ms 2 4160 1.08 MB/sec execute 34 sec latency 67.880 ms 2 4242 1.06 MB/sec execute 35 sec latency 100.927 ms 2 4293 1.04 MB/sec execute 36 sec latency 190.983 ms 2 4349 1.02 MB/sec execute 37 sec latency 267.889 ms 2 4387 1.00 MB/sec execute 38 sec latency 106.250 ms 2 4449 0.98 MB/sec execute 39 sec latency 112.702 ms 2 4489 0.96 MB/sec execute 40 sec latency 88.235 ms 2 4552 0.94 MB/sec execute 41 sec latency 72.393 ms 2 4648 0.97 MB/sec execute 42 sec latency 105.587 ms 2 4721 0.95 MB/sec execute 43 sec latency 94.920 ms 2 4795 0.93 MB/sec execute 44 sec latency 77.309 ms 2 4917 1.00 MB/sec execute 45 sec latency 71.559 ms 2 5010 1.02 MB/sec execute 46 sec latency 81.974 ms 2 5062 1.00 MB/sec execute 47 sec latency 85.622 ms 2 5138 0.98 MB/sec execute 48 sec latency 80.084 ms 2 5202 0.96 MB/sec execute 49 sec latency 88.014 ms 2 5253 0.95 MB/sec execute 50 sec latency 139.509 ms 2 5326 0.93 MB/sec execute 51 sec latency 74.867 ms 2 5409 0.92 MB/sec execute 52 sec latency 61.659 ms 2 5548 0.90 MB/sec execute 53 sec latency 52.425 ms 2 5645 0.89 MB/sec execute 54 sec latency 72.259 ms 2 5717 0.88 MB/sec execute 55 sec latency 97.413 ms 2 5811 0.87 MB/sec execute 56 sec latency 72.692 ms 2 5915 0.89 MB/sec execute 57 sec latency 73.248 ms 2 5969 0.88 MB/sec execute 58 sec latency 101.915 ms 2 6037 0.89 MB/sec execute 59 sec latency 94.178 ms 2 cleanup 60 sec 2 cleanup 61 sec 0 cleanup 62 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 1845 33.155 139.484 Close 1430 8.908 45.490 Rename 80 59.154 157.148 Unlink 313 13.385 71.610 Qpathinfo 1793 8.957 154.954 Qfileinfo 309 0.823 13.859 Qfsinfo 261 0.734 46.285 Sfileinfo 177 39.345 89.194 Find 633 2.109 100.890 WriteX 938 6.868 80.061 ReadX 2652 0.055 7.746 LockX 4 8.854 14.837 UnlockX 4 7.827 11.989 Flush 118 47.970 267.866 Throughput 0.886477 MB/sec 2 clients 2 procs max_latency=267.889 ms stopping dbench in /mnt/lustre/d2a.lustre-rsync-test at Mon Aug 17 02:18:57 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d2a.lustre-rsync-test /mnt/lustre/d2a.lustre-rsync-test /mnt/lustre/d2a.lustre-rsync-test removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2a.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl3 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 8 seconds Changelog records consumed: 2669 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 lustre-MDT0001: clear the changelog for cl3 of all records lustre-MDT0001: Deregistered changelog user #3 lustre-MDT0001: changelog user 'cl3' not found lustre-MDT0000: changelog user 'cl3' not found PASS 2a (109s) SKIP: lustre-rsync-test test_2b skipping ALWAYS excluded test 2b == lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 02:19:24 (1786947564) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl4 cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Mon Aug 17 02:19:34 EDT 2026 waiting for dbench pid 13546 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 1 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 92 8.39 MB/sec warmup 1 sec latency 117.253 ms 2 156 6.54 MB/sec warmup 2 sec latency 140.316 ms 2 207 5.40 MB/sec warmup 3 sec latency 130.366 ms 2 283 5.28 MB/sec warmup 4 sec latency 84.371 ms 2 336 4.85 MB/sec warmup 5 sec latency 112.010 ms 2 416 4.91 MB/sec warmup 6 sec latency 89.085 ms 2 493 4.91 MB/sec warmup 7 sec latency 72.633 ms Running lustre_rsync 2 520 4.48 MB/sec warmup 8 sec latency 194.665 ms 2 626 4.66 MB/sec warmup 9 sec latency 249.850 ms 2 678 4.23 MB/sec warmup 10 sec latency 133.828 ms 2 728 3.87 MB/sec warmup 11 sec latency 176.489 ms 2 800 0.22 MB/sec execute 1 sec latency 146.808 ms 2 858 0.21 MB/sec execute 2 sec latency 117.803 ms 2 892 0.21 MB/sec execute 3 sec latency 141.082 ms 2 929 0.21 MB/sec execute 4 sec latency 128.720 ms 2 976 0.20 MB/sec execute 5 sec latency 174.194 ms 2 1038 0.51 MB/sec execute 6 sec latency 144.495 ms 2 1091 0.45 MB/sec execute 7 sec latency 105.870 ms 2 1146 0.41 MB/sec execute 8 sec latency 162.612 ms 2 1194 0.37 MB/sec execute 9 sec latency 112.886 ms 2 1237 0.34 MB/sec execute 10 sec latency 119.608 ms 2 1351 0.67 MB/sec execute 11 sec latency 112.734 ms 2 1432 0.78 MB/sec execute 12 sec latency 81.048 ms 2 1482 0.72 MB/sec execute 13 sec latency 135.272 ms 2 1560 0.68 MB/sec execute 14 sec latency 75.854 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 19 seconds Changelog records consumed: 249 2 1643 0.64 MB/sec execute 15 sec latency 110.091 ms 2 1702 0.61 MB/sec execute 16 sec latency 86.178 ms 2 1778 0.58 MB/sec execute 17 sec latency 66.504 ms 2 1818 0.55 MB/sec execute 18 sec latency 114.390 ms 2 1861 0.53 MB/sec execute 19 sec latency 110.073 ms 13546 13547 13548 Running lustre_rsync 2 1949 0.51 MB/sec execute 20 sec latency 98.858 ms 2 2003 0.49 MB/sec execute 21 sec latency 119.324 ms 2 2066 0.48 MB/sec execute 22 sec latency 110.510 ms 2 2148 0.46 MB/sec execute 23 sec latency 91.990 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 2958 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 532 2 2210 0.45 MB/sec execute 24 sec latency 109.918 ms 2 2356 0.52 MB/sec execute 25 sec latency 56.074 ms 2 2403 0.51 MB/sec execute 26 sec latency 137.084 ms 2 2453 0.50 MB/sec execute 27 sec latency 158.386 ms 2 2570 0.54 MB/sec execute 28 sec latency 85.525 ms 13546 13547 13548 Running lustre_rsync 2 2615 0.53 MB/sec execute 29 sec latency 142.805 ms 2 2828 0.71 MB/sec execute 30 sec latency 104.119 ms 2 2928 0.78 MB/sec execute 31 sec latency 119.453 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3489 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 297 2 3016 0.76 MB/sec execute 32 sec latency 78.697 ms 2 3239 0.80 MB/sec execute 33 sec latency 73.426 ms 2 3366 0.83 MB/sec execute 34 sec latency 84.999 ms 2 3532 0.97 MB/sec execute 35 sec latency 102.487 ms 2 3631 0.96 MB/sec execute 36 sec latency 78.330 ms 13546 13547 13548 Running lustre_rsync 2 3693 0.94 MB/sec execute 37 sec latency 113.559 ms 2 3776 0.97 MB/sec execute 38 sec latency 84.002 ms 2 3821 0.94 MB/sec execute 39 sec latency 111.350 ms 2 3890 0.93 MB/sec execute 40 sec latency 83.198 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3785 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 276 2 3963 0.91 MB/sec execute 41 sec latency 73.818 ms 2 4044 0.89 MB/sec execute 42 sec latency 73.526 ms 2 4122 0.87 MB/sec execute 43 sec latency 119.834 ms 2 4210 0.85 MB/sec execute 44 sec latency 79.184 ms 2 4269 0.84 MB/sec execute 45 sec latency 145.550 ms 13546 13547 13548 Running lustre_rsync 2 4323 0.83 MB/sec execute 46 sec latency 87.557 ms 2 4381 0.82 MB/sec execute 47 sec latency 90.857 ms 2 4435 0.81 MB/sec execute 48 sec latency 125.223 ms 2 4480 0.79 MB/sec execute 49 sec latency 93.953 ms 2 4529 0.78 MB/sec execute 50 sec latency 113.033 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4060 Clear changelog after use: no Errors: 0 lustre_rsync took 5 seconds Changelog records consumed: 400 2 4580 0.79 MB/sec execute 51 sec latency 116.336 ms 2 4657 0.79 MB/sec execute 52 sec latency 94.387 ms 2 4712 0.78 MB/sec execute 53 sec latency 133.250 ms 2 4775 0.77 MB/sec execute 54 sec latency 70.069 ms 2 4887 0.81 MB/sec execute 55 sec latency 73.872 ms 13546 13547 13548 Running lustre_rsync 2 4972 0.85 MB/sec execute 56 sec latency 111.120 ms 2 5007 0.83 MB/sec execute 57 sec latency 125.098 ms 2 5057 0.82 MB/sec execute 58 sec latency 116.417 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4459 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 240 2 5125 0.81 MB/sec execute 59 sec latency 93.717 ms 2 cleanup 60 sec 2 cleanup 61 sec 2 cleanup 62 sec 0 cleanup 62 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 1510 41.634 158.323 Close 1127 10.286 53.715 Rename 70 65.596 174.167 Unlink 284 17.488 119.507 Qpathinfo 1404 10.931 113.528 Qfileinfo 238 1.057 25.236 Qfsinfo 244 0.973 22.008 Sfileinfo 154 44.751 104.490 Find 522 2.374 74.355 WriteX 764 7.799 105.416 ReadX 2343 0.063 13.088 LockX 4 19.518 24.802 UnlockX 4 16.650 30.020 Flush 112 51.233 145.531 Throughput 0.808386 MB/sec 2 clients 2 procs max_latency=174.194 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Mon Aug 17 02:20:49 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test Running lustre_rsync removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4698 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 253 Running final lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4950 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 18 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0001: clear the changelog for cl4 of all records lustre-MDT0001: Deregistered changelog user #4 lustre-MDT0001: changelog user 'cl4' not found lustre-MDT0000: changelog user 'cl4' not found PASS 2c (111s) == lustre-rsync-test test 3a: Replicate files created by createmany ========================================================== 02:21:15 (1786947675) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl5 cl5' lustre-MDT0000: Registered changelog user cl5 - open/close 560 (time 1786947696.69 total 10.00 last 55.99) total: 1000 open/close in 16.11 seconds: 62.06 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl5 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 77 seconds Changelog records consumed: 2000 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 lustre-MDT0001: clear the changelog for cl5 of all records lustre-MDT0001: Deregistered changelog user #5 lustre-MDT0001: changelog user 'cl5' not found lustre-MDT0000: changelog user 'cl5' not found PASS 3a (153s) == lustre-rsync-test test 3b: Replicate files created by writemany ========================================================== 02:23:48 (1786947828) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl6 cl6' lustre-MDT0000: Registered changelog user cl6 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl6 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 48 seconds Changelog records consumed: 6834 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 lustre-MDT0001: clear the changelog for cl6 of all records lustre-MDT0001: Deregistered changelog user #6 lustre-MDT0001: changelog user 'cl6' not found lustre-MDT0000: changelog user 'cl6' not found PASS 3b (133s) == lustre-rsync-test test 3c: Replicate files created by createmany/unlinkmany ========================================================== 02:26:01 (1786947961) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl7 cl7' lustre-MDT0000: Registered changelog user cl7 - open/close 658 (time 1786947981.98 total 10.00 last 65.78) total: 1000 open/close in 14.70 seconds: 68.01 ops/second - unlinked 0 (time 1786947992 ; total 0 ; last 0) total: 1000 unlinks in 8 seconds: 125.000000 unlinks/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl7 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 16 seconds Changelog records consumed: 3000 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 lustre-MDT0001: clear the changelog for cl7 of all records lustre-MDT0001: Deregistered changelog user #7 lustre-MDT0001: changelog user 'cl7' not found lustre-MDT0000: changelog user 'cl7' not found PASS 3c (71s) == lustre-rsync-test test 4: Replicate files created by iozone ========================================================== 02:27:12 (1786948032) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl8 cl8' lustre-MDT0000: Registered changelog user cl8 lmv_stripe_count: 0 lmv_stripe_offset: 0 lmv_hash_type: none /mnt/lustre/d4.lustre-rsync-test/d0.iozone-oleg133-client.virtnet stripe_count: 1 stripe_size: 4194304 pattern: stripe_offset: -1 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl8 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 415 /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh: line 448: 17434 Killed END_RUN_FILE=${DIR}/$tdir/run LOAD_PID_FILE=${DIR}/$tdir/pid MOUNT=${DIR}/$tdir RECOVERY_SCALE_ENABLE_REMOTE_DIRS=false RECOVERY_SCALE_ENABLE_STRIPED_DIRS=false run_iozone.sh Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl8 Starting changelog record: 17216 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 190 lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0001: clear the changelog for cl8 of all records lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 lustre-MDT0001: clear the changelog for cl8 of all records lustre-MDT0001: Deregistered changelog user #8 lustre-MDT0001: changelog user 'cl8' not found lustre-MDT0000: changelog user 'cl8' not found PASS 4 (124s) == lustre-rsync-test test 5a: Stop / start lustre_rsync == 02:29:16 (1786948156) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl9 cl9' lustre-MDT0000: Registered changelog user cl9 - open/close 490 (time 1786948179.54 total 10.00 last 48.99) - open/close 935 (time 1786948189.57 total 20.03 last 44.37) - open/close 1543 (time 1786948199.59 total 30.06 last 60.65) total: 2000 open/close in 37.78 seconds: 52.94 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl9 Starting changelog record: 0 Clear changelog after use: no lustre_rsync halting. Errors: 0 lustre_rsync took 30 seconds Changelog records consumed: 657 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl9 Starting changelog record: 18063 Clear changelog after use: no Errors: 0 lustre_rsync took 127 seconds Changelog records consumed: 3344 lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0001: clear the changelog for cl9 of all records lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 lustre-MDT0001: clear the changelog for cl9 of all records lustre-MDT0001: Deregistered changelog user #9 lustre-MDT0001: changelog user 'cl9' not found lustre-MDT0000: changelog user 'cl9' not found PASS 5a (266s) == lustre-rsync-test test 5b: Kill / restart lustre_rsync ========================================================== 02:33:43 (1786948423) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl10 cl10' lustre-MDT0000: Registered changelog user cl10 - open/close 803 (time 1786948444.35 total 10.00 last 80.30) - open/close 1525 (time 1786948454.36 total 20.00 last 72.18) total: 2000 open/close in 27.34 seconds: 73.16 ops/second /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh: line 538: 19512 Killed $LRSYNC -s $DIR -t $TGT -t $TGT2 -m $MDT0 -u $CL_USER -l $LREPL_LOG -D $LRSYNC_LOG Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl10 Starting changelog record: 21912 Clear changelog after use: no Errors: 0 lustre_rsync took 136 seconds Changelog records consumed: 3495 lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0001: clear the changelog for cl10 of all records lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 lustre-MDT0001: clear the changelog for cl10 of all records lustre-MDT0001: Deregistered changelog user #10 lustre-MDT0001: changelog user 'cl10' not found lustre-MDT0000: changelog user 'cl10' not found PASS 5b (263s) == lustre-rsync-test test 6: lustre_rsync large no of hard links ========================================================== 02:38:06 (1786948686) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl11 cl11' lustre-MDT0000: Registered changelog user cl11 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl11 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 129 lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0001: clear the changelog for cl11 of all records lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 lustre-MDT0001: clear the changelog for cl11 of all records lustre-MDT0001: Deregistered changelog user #11 lustre-MDT0001: changelog user 'cl11' not found lustre-MDT0000: changelog user 'cl11' not found PASS 6 (37s) == lustre-rsync-test test 7: lustre_rsync stripesize ===== 02:38:43 (1786948723) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl12 cl12' lustre-MDT0000: Registered changelog user cl12 total: 100 open/close in 1.58 seconds: 63.40 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/lustre/tgt Statuslog: /tmp/lustre_rsync.log Changelog registration: cl12 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 28 seconds Changelog records consumed: 202 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0001: clear the changelog for cl12 of all records lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 lustre-MDT0001: clear the changelog for cl12 of all records lustre-MDT0001: Deregistered changelog user #12 lustre-MDT0001: changelog user 'cl12' not found lustre-MDT0000: changelog user 'cl12' not found PASS 7 (67s) == lustre-rsync-test test 8: Replicate multiple file/directory moves ========================================================== 02:39:51 (1786948791) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl13 cl13' lustre-MDT0000: Registered changelog user cl13 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl13 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 95 seconds Changelog records consumed: 3501 lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0001: clear the changelog for cl13 of all records lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 lustre-MDT0001: clear the changelog for cl13 of all records lustre-MDT0001: Deregistered changelog user #13 lustre-MDT0001: changelog user 'cl13' not found lustre-MDT0000: changelog user 'cl13' not found PASS 8 (211s) == lustre-rsync-test test 9: Replicate recursive directory removal ========================================================== 02:43:22 (1786949002) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl14 cl14' lustre-MDT0000: Registered changelog user cl14 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl14 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 3 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl14 Starting changelog record: 29241 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 3 lustre-MDT0000: clear the changelog for cl14 of all records lustre-MDT0001: clear the changelog for cl14 of all records lustre-MDT0000: clear the changelog for cl14 of all records lustre-MDT0000: Deregistered changelog user #14 lustre-MDT0001: clear the changelog for cl14 of all records lustre-MDT0001: Deregistered changelog user #14 lustre-MDT0001: changelog user 'cl14' not found lustre-MDT0000: changelog user 'cl14' not found PASS 9 (22s) == lustre-rsync-test test complete, duration 1691 sec ==== 02:43:44 (1786949024) === lustre-rsync-test: start cleanup 02:43:46 (1786949026) === === lustre-rsync-test: finish cleanup 02:43:49 (1786949029) ===