== recovery-small test 52: failover OST under load ======= 14:42:26 (1767037346) writemany pid 47169 Failing ost1 on oleg138-server Stopping /mnt/lustre-ost1 (opts:) on oleg138-server 14:42:43 (1767037363) shut down facet: ost1 facet_host: oleg138-server facet_failover_host: oleg138-server Failover ost1 to oleg138-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg138-server: oleg138-server.virtnet: executing set_default_debug -1 all pdsh@oleg138-client: oleg138-server: ssh exited with exit code 1 Started lustre-OST0000 14:43:04 (1767037384) targets are mounted 14:43:04 (1767037384) facet_failover done oleg138-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 47991 Failing ost1 on oleg138-server Stopping /mnt/lustre-ost1 (opts:) on oleg138-server 14:48:14 (1767037694) shut down facet: ost1 facet_host: oleg138-server facet_failover_host: oleg138-server Failover ost1 to oleg138-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg138-server: oleg138-server.virtnet: executing set_default_debug -1 all pdsh@oleg138-client: oleg138-server: ssh exited with exit code 1 Started lustre-OST0000 14:48:33 (1767037713) targets are mounted 14:48:33 (1767037713) facet_failover done oleg138-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 48818 Failing ost1 on oleg138-server Stopping /mnt/lustre-ost1 (opts:) on oleg138-server 14:53:43 (1767038023) shut down facet: ost1 facet_host: oleg138-server facet_failover_host: oleg138-server Failover ost1 to oleg138-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg138-server: oleg138-server.virtnet: executing set_default_debug -1 all pdsh@oleg138-client: oleg138-server: ssh exited with exit code 1 Started lustre-OST0000 14:54:02 (1767038042) targets are mounted 14:54:02 (1767038042) facet_failover done oleg138-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg138-client.virtnet oleg138-client.virtnet