== recovery-small test 50: failover MDS under load ======= 13:48:58 (1790099338) writemany pid 41450 Failing mds1 on oleg206-server Stopping /mnt/lustre-mds1 (opts:) on oleg206-server 13:49:15 (1790099355) shut down facet: mds1 facet_host: oleg206-server facet_failover_host: oleg206-server Failover mds1 to oleg206-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg206-server: oleg206-server.virtnet: executing set_default_debug -1 all pdsh@oleg206-client: oleg206-server: ssh exited with exit code 1 Started lustre-MDT0000 13:49:40 (1790099380) targets are mounted 13:49:41 (1790099381) facet_failover done oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg206-server Stopping /mnt/lustre-mds1 (opts:) on oleg206-server 13:51:01 (1790099461) shut down facet: mds1 facet_host: oleg206-server facet_failover_host: oleg206-server Failover mds1 to oleg206-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg206-server: oleg206-server.virtnet: executing set_default_debug -1 all pdsh@oleg206-client: oleg206-server: ssh exited with exit code 1 Started lustre-MDT0000 13:51:36 (1790099496) targets are mounted 13:51:36 (1790099496) facet_failover done oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Failing mds1 on oleg206-server Stopping /mnt/lustre-mds1 (opts:) on oleg206-server 13:52:58 (1790099578) shut down facet: mds1 facet_host: oleg206-server facet_failover_host: oleg206-server Failover mds1 to oleg206-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg206-server: oleg206-server.virtnet: executing set_default_debug -1 all pdsh@oleg206-client: oleg206-server: ssh exited with exit code 1 Started lustre-MDT0000 13:53:21 (1790099601) targets are mounted 13:53:21 (1790099601) facet_failover done oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec writemany returned 0