== recovery-small test 50: failover MDS under load ======= 05:01:46 (1731751306) writemany pid 12936 Failing mds1 on oleg303-server Stopping /mnt/lustre-mds1 (opts:) on oleg303-server 05:01:57 (1731751317) shut down Failover mds1 to oleg303-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg303-server: oleg303-server.virtnet: executing set_default_debug -1 all pdsh@oleg303-client: oleg303-server: ssh exited with exit code 1 Started lustre-MDT0000 05:02:10 (1731751330) targets are mounted 05:02:10 (1731751330) facet_failover done oleg303-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg303-server Stopping /mnt/lustre-mds1 (opts:) on oleg303-server 05:03:18 (1731751398) shut down Failover mds1 to oleg303-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg303-server: oleg303-server.virtnet: executing set_default_debug -1 all pdsh@oleg303-client: oleg303-server: ssh exited with exit code 1 Started lustre-MDT0000 05:03:31 (1731751411) targets are mounted 05:03:31 (1731751411) facet_failover done oleg303-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg303-server Stopping /mnt/lustre-mds1 (opts:) on oleg303-server 05:04:38 (1731751478) shut down Failover mds1 to oleg303-server mount facets: mds1 Starting mds1: -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg303-server: oleg303-server.virtnet: executing set_default_debug -1 all pdsh@oleg303-client: oleg303-server: ssh exited with exit code 1 Started lustre-MDT0000 05:04:51 (1731751491) targets are mounted 05:04:51 (1731751491) facet_failover done oleg303-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec writemany returned 0