== recovery-small test 52: failover OST under load ======= 12:39:06 (1788799146) writemany pid 47445 Failing ost1 on oleg642-server Stopping /mnt/lustre-ost1 (opts:) on oleg642-server 12:39:23 (1788799163) shut down facet: ost1 facet_host: oleg642-server facet_failover_host: oleg642-server Failover ost1 to oleg642-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg642-server: oleg642-server.virtnet: executing set_default_debug -1 all pdsh@oleg642-client: oleg642-server: ssh exited with exit code 1 Started lustre-OST0000 12:39:47 (1788799187) targets are mounted 12:39:47 (1788799187) facet_failover done oleg642-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 48295 Failing ost1 on oleg642-server Stopping /mnt/lustre-ost1 (opts:) on oleg642-server 12:44:58 (1788799498) shut down facet: ost1 facet_host: oleg642-server facet_failover_host: oleg642-server Failover ost1 to oleg642-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg642-server: oleg642-server.virtnet: executing set_default_debug -1 all pdsh@oleg642-client: oleg642-server: ssh exited with exit code 1 Started lustre-OST0000 12:45:25 (1788799525) targets are mounted 12:45:25 (1788799525) facet_failover done oleg642-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 49146 Failing ost1 on oleg642-server Stopping /mnt/lustre-ost1 (opts:) on oleg642-server 12:50:25 (1788799825) shut down facet: ost1 facet_host: oleg642-server facet_failover_host: oleg642-server Failover ost1 to oleg642-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg642-server: oleg642-server.virtnet: executing set_default_debug -1 all pdsh@oleg642-client: oleg642-server: ssh exited with exit code 1 Started lustre-OST0000 12:50:52 (1788799852) targets are mounted 12:50:52 (1788799852) facet_failover done oleg642-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg642-client.virtnet oleg642-client.virtnet