== lustre-rsync-test test 2b: Replicate files changed by dbench. ========================================================== 17:44:32 (1748036672) mdd.lustre-MDT0000.changelog_mask=+hsm mdd.lustre-MDT0001.changelog_mask=+hsm Registered 2 changelog users: 'cl2 cl2' lustre-MDT0000: Registered changelog user cl2 waiting child_pid=$(pgrep dbench), 360 secs left ... looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2b.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2b.lustre-rsync-test at Fri May 23 17:44:34 EDT 2025 waiting for dbench pid 10621 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 500 34.93 MB/sec warmup 1 sec latency 13.827 ms 2 936 21.77 MB/sec warmup 2 sec latency 76.381 ms 2 1580 17.43 MB/sec warmup 3 sec latency 38.321 ms 2 2167 13.36 MB/sec warmup 4 sec latency 26.399 ms 2 2978 13.40 MB/sec warmup 5 sec latency 31.028 ms 2 3813 13.25 MB/sec warmup 6 sec latency 22.926 ms 2 4292 11.55 MB/sec warmup 7 sec latency 52.893 ms 2 4787 10.55 MB/sec warmup 8 sec latency 28.170 ms 2 5448 10.11 MB/sec warmup 9 sec latency 30.112 ms 2 6134 9.61 MB/sec warmup 10 sec latency 26.009 ms 2 7180 10.50 MB/sec warmup 11 sec latency 27.591 ms 2 8151 3.84 MB/sec execute 1 sec latency 52.803 ms 2 8817 5.26 MB/sec execute 2 sec latency 31.015 ms PIDs: 10621 10622 10623 Stopping dbench Starting replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 2 seconds Changelog records consumed: 3706 Resuming dbench 2 9128 2.00 MB/sec execute 6 sec latency 3115.142 ms 2 9863 3.34 MB/sec execute 7 sec latency 27.772 ms 2 10742 4.66 MB/sec execute 8 sec latency 35.596 ms 2 11186 4.46 MB/sec execute 9 sec latency 11.767 ms 2 11617 4.17 MB/sec execute 10 sec latency 46.287 ms 2 12274 4.60 MB/sec execute 11 sec latency 24.924 ms 2 12904 4.31 MB/sec execute 12 sec latency 30.300 ms 2 13646 5.04 MB/sec execute 13 sec latency 29.064 ms 2 14485 5.58 MB/sec execute 14 sec latency 21.498 ms 2 14965 5.30 MB/sec execute 15 sec latency 56.019 ms 2 15455 5.18 MB/sec execute 16 sec latency 23.053 ms Stopping dbench Starting replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 21281 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 2563 Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client0/~dmtmp/WORD: ~WRL1146.TMP Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client1/~dmtmp/WORD: ~WRL1146.TMP lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found. Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:113:check_diff() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:323:test_2b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6690:run_test() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:339:main() Dumping lctl log to /tmp/testlogs//lustre-rsync-test.test_2b.*.1748036704.log rsync: chown "/tmp/testlogs/.lustre-rsync-test.test_2b.debug_log.oleg242-server.1748036704.log.5R0E0u" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.lustre-rsync-test.test_2b.dmesg.oleg242-server.1748036704.log.uzPcfB" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] lustre-MDT0001: clear the changelog for cl2 of all records lustre-MDT0001: Deregistered changelog user #2 lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2