-----============= acceptance-small: lustre-rsync-test ============----- Tue Sep 8 07:24:17 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg343-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/lustre-rsync-test.*ex': No such file or directory excepting tests: 2b === lustre-rsync-test: start setup 07:24:33 (1788866673) === oleg343-client.virtnet: executing check_config_client /mnt/lustre oleg343-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg343-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9f8b03375800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9f8b03375800.idle_timeout=debug disable quota as required oleg343-server: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === lustre-rsync-test: finish setup 07:25:00 (1788866700) === nobody:x:65534: == lustre-rsync-test test 1A: Simple Replication ========= 07:25:01 (1788866701) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' lustre-MDT0000: Registered changelog user cl1 Replication #1 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl1 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 26 Replication #2 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl1 Starting changelog record: 26 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 3 lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 lustre-MDT0000: changelog user 'cl1' not found PASS 1A (16s) == lustre-rsync-test test 1a: Replicate create/delete operations in ROOT directory ========================================================== 07:25:17 (1788866717) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' lustre-MDT0000: Registered changelog user cl2 Replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 11 File: /mnt/target/root-dir Size: 0 Blocks: 0 IO Block: 4096 directory Device: 2bh/43d Inode: 47578 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-09-08 07:25:21.000000000 -0400 Modify: 2026-09-08 07:25:21.000000000 -0400 Change: 2026-09-08 07:25:22.089000000 -0400 Birth: - File: /mnt/target/root-file Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: 2bh/43d Inode: 47579 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-09-08 07:25:22.000000000 -0400 Modify: 2026-09-08 07:25:21.000000000 -0400 Change: 2026-09-08 07:25:22.154000000 -0400 Birth: - stat: cannot statx '/mnt/target/root-file2': No such file or directory File: /mnt/target/root-file3 Size: 0 Blocks: 0 IO Block: 4096 regular empty file Device: 2bh/43d Inode: 47580 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-09-08 07:25:22.000000000 -0400 Modify: 2026-09-08 07:25:21.000000000 -0400 Change: 2026-09-08 07:25:22.263000000 -0400 Birth: - stat: cannot statx '/mnt/target/root-dir1': No such file or directory stat: cannot statx '/mnt/target/root-file4': No such file or directory lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2 lustre-MDT0000: changelog user 'cl2' not found PASS 1a (15s) == lustre-rsync-test test 2a: Replicate files created by dbench. ========================================================== 07:25:32 (1788866732) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl3' lustre-MDT0000: Registered changelog user cl3 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2a.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2a.lustre-rsync-test at Tue Sep 8 07:25:40 EDT 2026 waiting for dbench pid 11486 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs failed to create barrier semaphore 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 81 7.34 MB/sec warmup 1 sec latency 113.875 ms 2 151 6.38 MB/sec warmup 2 sec latency 133.663 ms 2 189 5.03 MB/sec warmup 3 sec latency 234.796 ms 2 239 4.55 MB/sec warmup 4 sec latency 259.084 ms 2 296 4.34 MB/sec warmup 5 sec latency 128.979 ms 2 349 4.16 MB/sec warmup 6 sec latency 183.891 ms 2 397 4.01 MB/sec warmup 7 sec latency 132.758 ms 2 468 4.09 MB/sec warmup 8 sec latency 137.371 ms 2 532 4.12 MB/sec warmup 9 sec latency 94.134 ms 2 670 4.22 MB/sec warmup 10 sec latency 159.119 ms 2 715 3.86 MB/sec warmup 11 sec latency 111.410 ms 2 808 0.24 MB/sec execute 1 sec latency 183.536 ms 2 879 0.31 MB/sec execute 2 sec latency 199.291 ms 2 919 0.28 MB/sec execute 3 sec latency 200.085 ms 2 982 0.27 MB/sec execute 4 sec latency 185.708 ms 2 1098 0.64 MB/sec execute 5 sec latency 79.861 ms 2 1183 0.56 MB/sec execute 6 sec latency 61.474 ms 2 1249 0.49 MB/sec execute 7 sec latency 86.199 ms 2 1425 1.16 MB/sec execute 8 sec latency 84.852 ms 2 1497 1.04 MB/sec execute 9 sec latency 267.669 ms 2 1601 0.96 MB/sec execute 10 sec latency 60.366 ms 2 1692 0.88 MB/sec execute 11 sec latency 104.510 ms 2 1833 0.83 MB/sec execute 12 sec latency 52.849 ms 2 1963 0.78 MB/sec execute 13 sec latency 177.218 ms 2 2051 0.75 MB/sec execute 14 sec latency 77.075 ms 2 2150 0.71 MB/sec execute 15 sec latency 76.692 ms 2 2246 0.68 MB/sec execute 16 sec latency 76.465 ms 2 2371 0.77 MB/sec execute 17 sec latency 170.697 ms 2 2433 0.75 MB/sec execute 18 sec latency 142.324 ms 2 2558 0.79 MB/sec execute 19 sec latency 199.795 ms 2 2743 1.06 MB/sec execute 20 sec latency 61.315 ms 2 2921 1.15 MB/sec execute 21 sec latency 200.267 ms 2 3006 1.11 MB/sec execute 22 sec latency 159.961 ms 2 3221 1.13 MB/sec execute 23 sec latency 184.615 ms 2 3358 1.17 MB/sec execute 24 sec latency 147.337 ms 2 3556 1.36 MB/sec execute 25 sec latency 74.904 ms 2 3681 1.33 MB/sec execute 26 sec latency 58.767 ms 2 3791 1.36 MB/sec execute 27 sec latency 57.580 ms 2 3865 1.31 MB/sec execute 28 sec latency 109.029 ms 2 3949 1.29 MB/sec execute 29 sec latency 101.115 ms 2 4020 1.25 MB/sec execute 30 sec latency 76.896 ms 2 4132 1.21 MB/sec execute 31 sec latency 49.190 ms 2 4240 1.18 MB/sec execute 32 sec latency 250.956 ms 2 4290 1.15 MB/sec execute 33 sec latency 152.953 ms 2 4353 1.13 MB/sec execute 34 sec latency 109.013 ms 2 4426 1.10 MB/sec execute 35 sec latency 131.392 ms 2 4484 1.08 MB/sec execute 36 sec latency 170.581 ms 2 4557 1.06 MB/sec execute 37 sec latency 132.420 ms 2 4691 1.09 MB/sec execute 38 sec latency 73.810 ms 2 4765 1.07 MB/sec execute 39 sec latency 54.372 ms 2 4914 1.14 MB/sec execute 40 sec latency 55.569 ms 2 5015 1.16 MB/sec execute 41 sec latency 75.012 ms 2 5103 1.13 MB/sec execute 42 sec latency 177.687 ms 2 5156 1.11 MB/sec execute 43 sec latency 96.836 ms 2 5242 1.09 MB/sec execute 44 sec latency 120.483 ms 2 5293 1.07 MB/sec execute 45 sec latency 78.249 ms 2 5361 1.05 MB/sec execute 46 sec latency 69.125 ms 2 5439 1.03 MB/sec execute 47 sec latency 68.725 ms 2 5547 1.01 MB/sec execute 48 sec latency 141.694 ms 2 5603 0.99 MB/sec execute 49 sec latency 86.040 ms 2 5713 0.98 MB/sec execute 50 sec latency 77.173 ms 2 5799 0.96 MB/sec execute 51 sec latency 62.759 ms 2 5921 0.99 MB/sec execute 52 sec latency 158.722 ms 2 5982 0.97 MB/sec execute 53 sec latency 187.830 ms 2 6057 0.98 MB/sec execute 54 sec latency 151.550 ms 2 6265 1.05 MB/sec execute 55 sec latency 60.971 ms 2 6468 1.10 MB/sec execute 56 sec latency 178.164 ms 2 6560 1.10 MB/sec execute 57 sec latency 189.930 ms 2 6794 1.11 MB/sec execute 58 sec latency 166.301 ms 2 6952 1.13 MB/sec execute 59 sec latency 83.285 ms 2 cleanup 60 sec 2 cleanup 61 sec 0 cleanup 61 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 2083 27.760 109.021 Close 1615 7.279 39.810 Rename 96 44.599 98.624 Unlink 356 11.258 51.432 Qpathinfo 1995 7.518 71.300 Qfileinfo 373 0.570 9.356 Qfsinfo 354 0.398 16.813 Sfileinfo 188 28.033 78.292 Find 788 1.378 41.335 WriteX 1110 4.204 49.355 ReadX 3701 0.051 10.852 LockX 8 6.817 12.992 UnlockX 8 6.656 14.146 Flush 148 103.903 267.636 Throughput 1.13146 MB/sec 2 clients 2 procs max_latency=267.669 ms stopping dbench in /mnt/lustre/d2a.lustre-rsync-test at Tue Sep 8 07:26:54 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d2a.lustre-rsync-test /mnt/lustre/d2a.lustre-rsync-test /mnt/lustre/d2a.lustre-rsync-test removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2a.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl3 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 7 seconds Changelog records consumed: 2951 lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: clear the changelog for cl3 of all records lustre-MDT0000: Deregistered changelog user #3 lustre-MDT0000: changelog user 'cl3' not found PASS 2a (99s) SKIP: lustre-rsync-test test_2b skipping ALWAYS excluded test 2b == lustre-rsync-test test 2c: Replicate files while dbench is running. ========================================================== 07:27:12 (1788866832) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl4' lustre-MDT0000: Registered changelog user cl4 looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2c.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2c.lustre-rsync-test at Tue Sep 8 07:27:19 EDT 2026 waiting for dbench pid 12412 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 92 8.39 MB/sec warmup 1 sec latency 166.058 ms 2 161 6.67 MB/sec warmup 2 sec latency 127.003 ms 2 203 5.31 MB/sec warmup 3 sec latency 199.147 ms 2 271 5.09 MB/sec warmup 4 sec latency 126.371 ms 2 335 4.85 MB/sec warmup 5 sec latency 121.531 ms 2 408 4.81 MB/sec warmup 6 sec latency 84.954 ms Running lustre_rsync 2 477 4.76 MB/sec warmup 7 sec latency 112.949 ms 2 523 4.51 MB/sec warmup 8 sec latency 159.625 ms 2 664 4.70 MB/sec warmup 9 sec latency 132.474 ms 2 698 4.24 MB/sec warmup 10 sec latency 243.025 ms 2 731 3.87 MB/sec warmup 11 sec latency 218.868 ms 2 830 0.23 MB/sec execute 1 sec latency 225.242 ms 2 885 0.26 MB/sec execute 2 sec latency 182.494 ms 2 918 0.24 MB/sec execute 3 sec latency 221.441 ms 2 982 0.25 MB/sec execute 4 sec latency 121.431 ms 2 1071 0.60 MB/sec execute 5 sec latency 148.594 ms 2 1139 0.53 MB/sec execute 6 sec latency 79.878 ms 2 1206 0.47 MB/sec execute 7 sec latency 66.566 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 13 seconds Changelog records consumed: 233 2 1271 0.43 MB/sec execute 8 sec latency 62.125 ms 2 1443 1.02 MB/sec execute 9 sec latency 78.839 ms 2 1503 0.93 MB/sec execute 10 sec latency 201.044 ms 2 1608 0.86 MB/sec execute 11 sec latency 60.757 ms 2 1678 0.80 MB/sec execute 12 sec latency 172.079 ms 12412 12414 12415 Running lustre_rsync 2 1722 0.74 MB/sec execute 13 sec latency 99.936 ms 2 1776 0.69 MB/sec execute 14 sec latency 107.622 ms 2 1811 0.65 MB/sec execute 15 sec latency 141.501 ms 2 1861 0.62 MB/sec execute 16 sec latency 115.893 ms 2 1938 0.59 MB/sec execute 17 sec latency 224.947 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3224 Clear changelog after use: no Errors: 0 lustre_rsync took 5 seconds Changelog records consumed: 480 2 2010 0.57 MB/sec execute 18 sec latency 73.018 ms 2 2117 0.55 MB/sec execute 19 sec latency 77.334 ms 2 2186 0.53 MB/sec execute 20 sec latency 70.279 ms 2 2345 0.62 MB/sec execute 21 sec latency 80.580 ms 2 2388 0.59 MB/sec execute 22 sec latency 297.828 ms 12412 12414 12415 Running lustre_rsync 2 2433 0.58 MB/sec execute 23 sec latency 230.998 ms 2 2478 0.61 MB/sec execute 24 sec latency 239.152 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3703 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 293 2 2583 0.60 MB/sec execute 25 sec latency 78.935 ms 2 2768 0.81 MB/sec execute 26 sec latency 108.897 ms 2 2922 0.89 MB/sec execute 27 sec latency 295.993 ms 2 2995 0.86 MB/sec execute 28 sec latency 263.215 ms 2 3180 0.88 MB/sec execute 29 sec latency 412.779 ms 12412 12414 12415 Running lustre_rsync 2 3266 0.91 MB/sec execute 30 sec latency 215.011 ms 2 3371 0.90 MB/sec execute 31 sec latency 174.358 ms 2 3530 1.06 MB/sec execute 32 sec latency 109.764 ms 2 3606 1.03 MB/sec execute 33 sec latency 89.632 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 3995 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 194 2 3687 1.02 MB/sec execute 34 sec latency 90.393 ms 2 3782 1.05 MB/sec execute 35 sec latency 96.946 ms 2 3850 1.02 MB/sec execute 36 sec latency 81.460 ms 2 3945 1.01 MB/sec execute 37 sec latency 73.138 ms 2 4020 0.98 MB/sec execute 38 sec latency 63.364 ms 12412 12414 12415 Running lustre_rsync 2 4095 0.96 MB/sec execute 39 sec latency 94.925 ms 2 4197 0.93 MB/sec execute 40 sec latency 91.326 ms 2 4253 0.92 MB/sec execute 41 sec latency 157.731 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4188 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 421 2 4304 0.90 MB/sec execute 42 sec latency 163.698 ms 2 4362 0.89 MB/sec execute 43 sec latency 180.849 ms 2 4443 0.88 MB/sec execute 44 sec latency 107.166 ms 2 4486 0.86 MB/sec execute 45 sec latency 180.351 ms 2 4549 0.85 MB/sec execute 46 sec latency 85.977 ms 12412 12414 12415 Running lustre_rsync 2 4613 0.88 MB/sec execute 47 sec latency 182.273 ms 2 4690 0.86 MB/sec execute 48 sec latency 68.436 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4608 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 245 2 4741 0.84 MB/sec execute 49 sec latency 125.120 ms 2 4814 0.83 MB/sec execute 50 sec latency 65.209 ms 2 4983 0.93 MB/sec execute 51 sec latency 70.567 ms 2 5041 0.91 MB/sec execute 52 sec latency 86.104 ms 2 5126 0.90 MB/sec execute 53 sec latency 152.114 ms 2 5185 0.88 MB/sec execute 54 sec latency 68.935 ms 12412 12414 12415 Running lustre_rsync 2 5247 0.87 MB/sec execute 55 sec latency 149.312 ms 2 5296 0.86 MB/sec execute 56 sec latency 78.870 ms Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 4852 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 229 2 5358 0.84 MB/sec execute 57 sec latency 121.305 ms 2 5442 0.83 MB/sec execute 58 sec latency 67.761 ms 2 5532 0.82 MB/sec execute 59 sec latency 162.501 ms 2 cleanup 60 sec 2 cleanup 61 sec 12412 12414 12415 Running lustre_rsync 1 cleanup 62 sec 0 cleanup 62 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 1703 35.456 141.487 Close 1287 8.822 45.779 Rename 70 53.147 125.098 Unlink 294 14.175 41.718 Qpathinfo 1594 8.957 134.679 Qfileinfo 271 0.609 14.175 Qfsinfo 244 0.856 39.153 Sfileinfo 154 37.029 96.184 Find 564 1.851 44.328 WriteX 822 5.188 76.034 ReadX 2469 0.044 5.082 LockX 4 8.332 11.579 UnlockX 4 7.891 10.984 Flush 122 120.576 412.765 Throughput 0.817658 MB/sec 2 clients 2 procs max_latency=412.779 ms stopping dbench in /mnt/lustre/d2c.lustre-rsync-test at Tue Sep 8 07:28:34 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test /mnt/lustre/d2c.lustre-rsync-test removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d2c.lustre-rsync-test dbench successfully finished Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5080 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 287 Running lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5366 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 88 Running final lustre_rsync Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl4 Starting changelog record: 5453 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 1 lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: clear the changelog for cl4 of all records lustre-MDT0000: Deregistered changelog user #4 lustre-MDT0000: changelog user 'cl4' not found PASS 2c (106s) == lustre-rsync-test test 3a: Replicate files created by createmany ========================================================== 07:28:58 (1788866938) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl5' lustre-MDT0000: Registered changelog user cl5 - open/close 609 (time 1788866954.89 total 10.00 last 60.88) total: 1000 open/close in 16.35 seconds: 61.18 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl5 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 79 seconds Changelog records consumed: 2000 lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: clear the changelog for cl5 of all records lustre-MDT0000: Deregistered changelog user #5 lustre-MDT0000: changelog user 'cl5' not found PASS 3a (138s) == lustre-rsync-test test 3b: Replicate files created by writemany ========================================================== 07:31:16 (1788867076) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl6' lustre-MDT0000: Registered changelog user cl6 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl6 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 38 seconds Changelog records consumed: 6432 lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: clear the changelog for cl6 of all records lustre-MDT0000: Deregistered changelog user #6 lustre-MDT0000: changelog user 'cl6' not found PASS 3b (116s) == lustre-rsync-test test 3c: Replicate files created by createmany/unlinkmany ========================================================== 07:33:12 (1788867192) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl7' lustre-MDT0000: Registered changelog user cl7 - open/close 657 (time 1788867208.60 total 10.01 last 65.65) total: 1000 open/close in 15.63 seconds: 64.00 ops/second - unlinked 0 (time 1788867218 ; total 0 ; last 0) total: 1000 unlinks in 8 seconds: 125.000000 unlinks/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl7 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 15 seconds Changelog records consumed: 3000 lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: clear the changelog for cl7 of all records lustre-MDT0000: Deregistered changelog user #7 lustre-MDT0000: changelog user 'cl7' not found PASS 3c (61s) == lustre-rsync-test test 4: Replicate files created by iozone ========================================================== 07:34:13 (1788867253) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl8' lustre-MDT0000: Registered changelog user cl8 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl8 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 424 /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh: line 448: 15943 Killed END_RUN_FILE=${DIR}/$tdir/run LOAD_PID_FILE=${DIR}/$tdir/pid MOUNT=${DIR}/$tdir RECOVERY_SCALE_ENABLE_REMOTE_DIRS=false RECOVERY_SCALE_ENABLE_STRIPED_DIRS=false run_iozone.sh Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl8 Starting changelog record: 17309 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 208 lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: clear the changelog for cl8 of all records lustre-MDT0000: Deregistered changelog user #8 lustre-MDT0000: changelog user 'cl8' not found PASS 4 (112s) == lustre-rsync-test test 5a: Stop / start lustre_rsync == 07:36:05 (1788867365) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl9' lustre-MDT0000: Registered changelog user cl9 - open/close 653 (time 1788867382.92 total 10.03 last 65.13) - open/close 1278 (time 1788867392.93 total 20.03 last 62.44) - open/close 1909 (time 1788867402.94 total 30.04 last 63.07) total: 2000 open/close in 31.49 seconds: 63.52 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl9 Starting changelog record: 0 Clear changelog after use: no lustre_rsync halting. Errors: 0 lustre_rsync took 30 seconds Changelog records consumed: 819 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl9 Starting changelog record: 18336 Clear changelog after use: no Errors: 0 lustre_rsync took 114 seconds Changelog records consumed: 3182 lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: clear the changelog for cl9 of all records lustre-MDT0000: Deregistered changelog user #9 lustre-MDT0000: changelog user 'cl9' not found PASS 5a (239s) == lustre-rsync-test test 5b: Kill / restart lustre_rsync ========================================================== 07:40:04 (1788867604) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl10' lustre-MDT0000: Registered changelog user cl10 - open/close 594 (time 1788867621.79 total 10.01 last 59.35) - open/close 1228 (time 1788867631.80 total 20.01 last 63.36) - open/close 1826 (time 1788867641.82 total 30.03 last 59.71) total: 2000 open/close in 32.60 seconds: 61.35 ops/second /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh: line 538: 17834 Killed $LRSYNC -s $DIR -t $TGT -t $TGT2 -m $MDT0 -u $CL_USER -l $LREPL_LOG -D $LRSYNC_LOG Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl10 Starting changelog record: 22124 Clear changelog after use: no Errors: 0 lustre_rsync took 127 seconds Changelog records consumed: 3394 lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: clear the changelog for cl10 of all records lustre-MDT0000: Deregistered changelog user #10 lustre-MDT0000: changelog user 'cl10' not found PASS 5b (258s) == lustre-rsync-test test 6: lustre_rsync large no of hard links ========================================================== 07:44:23 (1788867863) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl11' lustre-MDT0000: Registered changelog user cl11 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Target: /mnt/target2 Statuslog: /tmp/lustre_rsync.log Changelog registration: cl11 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 4 seconds Changelog records consumed: 129 lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: clear the changelog for cl11 of all records lustre-MDT0000: Deregistered changelog user #11 lustre-MDT0000: changelog user 'cl11' not found PASS 6 (30s) == lustre-rsync-test test 7: lustre_rsync stripesize ===== 07:44:52 (1788867892) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl12' lustre-MDT0000: Registered changelog user cl12 total: 100 open/close in 1.82 seconds: 54.91 ops/second Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/lustre/tgt Statuslog: /tmp/lustre_rsync.log Changelog registration: cl12 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 41 seconds Changelog records consumed: 202 lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: clear the changelog for cl12 of all records lustre-MDT0000: Deregistered changelog user #12 lustre-MDT0000: changelog user 'cl12' not found PASS 7 (70s) == lustre-rsync-test test 8: Replicate multiple file/directory moves ========================================================== 07:46:03 (1788867963) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl13' lustre-MDT0000: Registered changelog user cl13 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl13 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 107 seconds Changelog records consumed: 3501 lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: clear the changelog for cl13 of all records lustre-MDT0000: Deregistered changelog user #13 lustre-MDT0000: changelog user 'cl13' not found PASS 8 (228s) == lustre-rsync-test test 9: Replicate recursive directory removal ========================================================== 07:49:51 (1788868191) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl14' lustre-MDT0000: Registered changelog user cl14 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl14 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 0 seconds Changelog records consumed: 3 Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /mnt/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl14 Starting changelog record: 30156 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 3 lustre-MDT0000: clear the changelog for cl14 of all records lustre-MDT0000: clear the changelog for cl14 of all records lustre-MDT0000: Deregistered changelog user #14 lustre-MDT0000: changelog user 'cl14' not found PASS 9 (18s) == lustre-rsync-test test complete, duration 1551 sec ==== 07:50:09 (1788868209) === lustre-rsync-test: start cleanup 07:50:11 (1788868211) === === lustre-rsync-test: finish cleanup 07:50:15 (1788868215) ===