== recovery-small test 50: failover MDS under load ======= 00:20:42 (1721881242) writemany pid 10829 Failing mds1 on oleg450-server Stopping /mnt/lustre-mds1 (opts:) on oleg450-server 00:20:54 (1721881254) shut down Failover mds1 to oleg450-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg450-server: oleg450-server.virtnet: executing set_default_debug -1 all pdsh@oleg450-client: oleg450-server: ssh exited with exit code 1 Started lustre-MDT0000 00:21:07 (1721881267) targets are mounted 00:21:07 (1721881267) facet_failover done oleg450-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg450-server Stopping /mnt/lustre-mds1 (opts:) on oleg450-server 00:22:15 (1721881335) shut down Failover mds1 to oleg450-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg450-server: oleg450-server.virtnet: executing set_default_debug -1 all pdsh@oleg450-client: oleg450-server: ssh exited with exit code 1 Started lustre-MDT0000 00:22:28 (1721881348) targets are mounted 00:22:28 (1721881348) facet_failover done oleg450-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg450-server Stopping /mnt/lustre-mds1 (opts:) on oleg450-server 00:23:35 (1721881415) shut down Failover mds1 to oleg450-server mount facets: mds1 Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg450-server: oleg450-server.virtnet: executing set_default_debug -1 all pdsh@oleg450-client: oleg450-server: ssh exited with exit code 1 Started lustre-MDT0000 00:23:48 (1721881428) targets are mounted 00:23:48 (1721881428) facet_failover done oleg450-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec writemany returned 0