== replay-vbr test 12a: lost data due to missed REMOTE client during replay ========================================================== 00:53:57 (1782363237) Starting client: oleg128-client.virtnet: -o user_xattr,flock 192.168.201.128@tcp:/lustre /mnt/lustre2 mdt.lustre-MDT0000.commit_on_sharing=0 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1864 1269440 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1696 1269608 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3088 7210952 1% /mnt/lustre total: 25 open/close in 0.10 seconds: 248.63 ops/second total: 25 open/close in 0.09 seconds: 267.89 ops/second Stopping client oleg128-client.virtnet /mnt/lustre2 (opts:) Failing mds1 on oleg128-server Stopping /mnt/lustre-mds1 (opts:) on oleg128-server 00:54:03 (1782363243) shut down facet: mds1 facet_host: oleg128-server facet_failover_host: oleg128-server Failover mds1 to oleg128-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg128-server: oleg128-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Started lustre-MDT0000 00:54:18 (1782363258) targets are mounted 00:54:18 (1782363258) facet_failover done pdsh@oleg128-client: oleg128-client: ssh exited with exit code 5 replay-vbr test_12a: @@@@@@ FAIL: test_12a failed with 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7447:error() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7823:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7886:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7701:run_test() = /home/green/git/lustre-release/lustre/tests/replay-vbr.sh:1166:main() Dumping lctl log to /tmp/testlogs//replay-vbr.test_12a.*.1782363442.log rsync: chown "/tmp/testlogs/.replay-vbr.test_12a.debug_log.oleg128-server.1782363442.log.z8FgLc" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.replay-vbr.test_12a.dmesg.oleg128-server.1782363442.log.sAjNIH" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]