== replay-single test 62: don't mis-drop resent replay === 01:19:09 (1782364749) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2308 1268996 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2028 1269276 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1632 3605388 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1608 3605412 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3240 7210800 1% /mnt/lustre total: 25 open/close in 0.07 seconds: 352.70 ops/second fail_loc=0x80000707 Failing mds1 on oleg440-server Stopping /mnt/lustre-mds1 (opts:) on oleg440-server 01:19:15 (1782364755) shut down facet: mds1 facet_host: oleg440-server facet_failover_host: oleg440-server Failover mds1 to oleg440-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg440-server: oleg440-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg440-client: oleg440-server: ssh exited with exit code 1 Started lustre-MDT0000 01:19:31 (1782364771) targets are mounted 01:19:31 (1782364771) facet_failover done pdsh@oleg440-client: oleg440-client: ssh exited with exit code 5 oleg440-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec fail_loc=0 - unlinked 0 (time 1782364960 ; total 0 ; last 0) unlink(/mnt/lustre/d62.replay-single/f62.replay-single-12) error: No such file or directory total: 12 unlinks in 0 seconds: inf unlinks/second replay-single test_62: @@@@@@ FAIL: unlinkmany /mnt/lustre/d62.replay-single/f62.replay-single failed Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7447:error() = /home/green/git/lustre-release/lustre/tests/replay-single.sh:1711:test_62() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7823:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7886:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7686:run_test() = /home/green/git/lustre-release/lustre/tests/replay-single.sh:1714:main() Dumping lctl log to /tmp/testlogs//replay-single.test_62.*.1782364961.log rsync: chown "/tmp/testlogs/.replay-single.test_62.debug_log.oleg440-server.1782364961.log.IPeLBW" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.replay-single.test_62.dmesg.oleg440-server.1782364961.log.womPRL" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]