== conf-sanity test 121: failover MGS ==================== 18:01:34 (1746136894) Stopping clients: oleg454-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg454-client.virtnet /mnt/lustre2 (opts:) start mds service on oleg454-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg454-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid Failing mgs on oleg454-server Stopping /mnt/lustre-mds1 (opts:) on oleg454-server 18:01:58 (1746136918) shut down facet: mgs facet_host: oleg454-server facet_failover_host: oleg454-server Failover mgs to oleg454-server mount facets: mgs Starting mgs: /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0000 18:02:14 (1746136934) targets are mounted 18:02:14 (1746136934) facet_failover done pdsh@oleg454-client: oleg454-client: ssh exited with exit code 95 oleg454-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid pdsh@oleg454-client: oleg454-client: ssh exited with exit code 95 stop mds service on oleg454-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg454-server stop mds service on oleg454-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg454-server start mds service on oleg454-server Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg454-server Starting mds2: -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid oleg454-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid Failing mgs on oleg454-server Stopping /mnt/lustre-mds1 (opts:) on oleg454-server 18:02:45 (1746136965) shut down facet: mgs facet_host: oleg454-server facet_failover_host: oleg454-server Failover mgs to oleg454-server mount facets: mgs Starting mgs: /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg454-server: oleg454-server.virtnet: executing set_default_debug -1 all pdsh@oleg454-client: oleg454-server: ssh exited with exit code 1 Started lustre-MDT0000 18:03:01 (1746136981) targets are mounted 18:03:01 (1746136981) facet_failover done pdsh@oleg454-client: oleg454-client: ssh exited with exit code 95 oleg454-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid pdsh@oleg454-client: oleg454-client: ssh exited with exit code 95 stop mds service on oleg454-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg454-server stop mds service on oleg454-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg454-server