== replay-dual test 16: fail MDS during recovery (3571) == 00:42:06 (1708839726) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1916 1285772 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1800 1285888 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1796 3605224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1796 3605224 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3592 7210448 1% /mnt/lustre total: 25 open/close in 0.24 seconds: 104.46 ops/second total: 1 open/close in 0.01 seconds: 86.37 ops/second Failing mds1 on oleg318-server Stopping /mnt/lustre-mds1 (opts:) on oleg318-server 00:42:11 (1708839731) shut down Failover mds1 to oleg318-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg318-server: oleg318-server.virtnet: executing set_default_debug -1 all pdsh@oleg318-client: oleg318-server: ssh exited with exit code 1 Started lustre-MDT0000 00:42:25 (1708839745) targets are mounted 00:42:25 (1708839745) facet_failover done Failing mds1 on oleg318-server Stopping /mnt/lustre-mds1 (opts:) on oleg318-server 00:42:47 (1708839767) shut down Failover mds1 to oleg318-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg318-server: oleg318-server.virtnet: executing set_default_debug -1 all pdsh@oleg318-client: oleg318-server: ssh exited with exit code 1 Started lustre-MDT0000 00:43:00 (1708839780) targets are mounted 00:43:00 (1708839780) facet_failover done oleg318-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec - unlinked 0 (time 1708839852 ; total 0 ; last 0) total: 25 unlinks in 1 seconds: 25.000000 unlinks/second Starting client: oleg318-client.virtnet: -o user_xattr,flock oleg318-server@tcp:/lustre /mnt/lustre2