== lustre-rsync-test test 2b: Replicate files changed by dbench. ========================================================== 17:44:29 (1748036669) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl2' lustre-MDT0000: Registered changelog user cl2 waiting child_pid=$(pgrep dbench), 360 secs left ... looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d2b.lustre-rsync-test '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2 -t 60' in /mnt/lustre/d2b.lustre-rsync-test at Fri May 23 17:44:31 EDT 2025 waiting for dbench pid 9656 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 60 seconds with load 'client.txt' and minimum warmup 12 secs 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 2 603 41.94 MB/sec warmup 1 sec latency 10.587 ms 2 1261 23.11 MB/sec warmup 2 sec latency 8.574 ms 2 2012 17.68 MB/sec warmup 3 sec latency 11.444 ms 2 2901 16.41 MB/sec warmup 4 sec latency 11.268 ms 2 3832 15.90 MB/sec warmup 5 sec latency 10.823 ms 2 4370 13.53 MB/sec warmup 6 sec latency 13.331 ms 2 5058 12.90 MB/sec warmup 7 sec latency 12.415 ms 2 5749 11.47 MB/sec warmup 8 sec latency 8.648 ms 2 6726 11.83 MB/sec warmup 9 sec latency 10.700 ms 2 7492 11.84 MB/sec warmup 10 sec latency 9.984 ms 2 8080 10.92 MB/sec warmup 11 sec latency 13.036 ms 2 9564 4.16 MB/sec execute 1 sec latency 11.726 ms 2 10719 12.37 MB/sec execute 2 sec latency 9.404 ms PIDs: 9656 9657 9658 Stopping dbench Starting replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 0 Clear changelog after use: no Errors: 0 lustre_rsync took 3 seconds Changelog records consumed: 4368 Resuming dbench 2 10992 4.81 MB/sec execute 6 sec latency 3270.548 ms 2 11564 4.32 MB/sec execute 7 sec latency 3271.623 ms 2 12269 4.91 MB/sec execute 8 sec latency 13.949 ms 2 12999 4.75 MB/sec execute 9 sec latency 9.998 ms 2 13981 5.80 MB/sec execute 10 sec latency 11.463 ms 2 14591 6.13 MB/sec execute 11 sec latency 10.105 ms 2 15139 5.75 MB/sec execute 12 sec latency 14.267 ms 2 15847 5.99 MB/sec execute 13 sec latency 12.353 ms 2 16582 5.81 MB/sec execute 14 sec latency 9.528 ms 2 17577 6.44 MB/sec execute 15 sec latency 10.759 ms 2 18220 6.61 MB/sec execute 16 sec latency 9.842 ms Stopping dbench Starting replication Lustre filesystem: lustre MDT device: lustre-MDT0000 Source: /mnt/lustre Target: /tmp/target Statuslog: /tmp/lustre_rsync.log Changelog registration: cl2 Starting changelog record: 24932 Clear changelog after use: no Errors: 0 lustre_rsync took 1 seconds Changelog records consumed: 2983 Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client0/~dmtmp/COREL: GRAPH1.BAK Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client0/~dmtmp/COREL: GRAPH2.BAK Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client1/~dmtmp/COREL: GRAPH1.BAK Only in /mnt/lustre/d2b.lustre-rsync-test/clients/client1/~dmtmp/COREL: GRAPH2.BAK lustre-rsync-test test_2b: @@@@@@ FAIL: Failure in replication; differences found. Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:113:check_diff() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:323:test_2b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6690:run_test() = /home/green/git/lustre-release/lustre/tests/lustre-rsync-test.sh:339:main() Dumping lctl log to /tmp/testlogs//lustre-rsync-test.test_2b.*.1748036701.log rsync: chown "/tmp/testlogs/.lustre-rsync-test.test_2b.debug_log.oleg203-server.1748036701.log.JLh8RB" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.lustre-rsync-test.test_2b.dmesg.oleg203-server.1748036701.log.htF9St" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] lustre-MDT0000: clear the changelog for cl2 of all records lustre-MDT0000: Deregistered changelog user #2