== conf-sanity test 121: failover MGS ==================== 16:28:44 (1786566524) Stopping clients: oleg256-client.virtnet /mnt/lustre (opts:) Stopping clients: oleg256-client.virtnet /mnt/lustre2 (opts:) start mds service on oleg256-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg256-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg256-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg256-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 Failing mgs on oleg256-server Stopping /mnt/lustre-mds1 (opts:) on oleg256-server 16:29:41 (1786566581) shut down facet: mgs facet_host: oleg256-server facet_failover_host: oleg256-server Failover mgs to oleg256-server mount facets: mgs Start mgs: mount -t lustre /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0000 16:30:02 (1786566602) targets are mounted 16:30:02 (1786566602) facet_failover done pdsh@oleg256-client: oleg256-client: ssh exited with exit code 95 oleg256-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid 1475 0 pdsh@oleg256-client: oleg256-client: ssh exited with exit code 95 stop mds service on oleg256-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg256-server stop mds service on oleg256-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg256-server start mds service on oleg256-server Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0000 start mds service on oleg256-server Start mds2: mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0001 oleg256-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 oleg256-client.virtnet: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid 1475 0 Failing mgs on oleg256-server Stopping /mnt/lustre-mds1 (opts:) on oleg256-server 16:30:57 (1786566657) shut down facet: mgs facet_host: oleg256-server facet_failover_host: oleg256-server Failover mgs to oleg256-server mount facets: mgs Start mgs: mount -t lustre /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg256-server: oleg256-server.virtnet: executing set_default_debug -1 all pdsh@oleg256-client: oleg256-server: ssh exited with exit code 1 Started lustre-MDT0000 16:31:18 (1786566678) targets are mounted 16:31:18 (1786566678) facet_failover done pdsh@oleg256-client: oleg256-client: ssh exited with exit code 95 oleg256-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mgc.*.mgs_server_uuid 1475 0 pdsh@oleg256-client: oleg256-client: ssh exited with exit code 95 stop mds service on oleg256-server Stopping /mnt/lustre-mds1 (opts:-f) on oleg256-server stop mds service on oleg256-server Stopping /mnt/lustre-mds2 (opts:-f) on oleg256-server