== recovery-small test 52: failover OST under load ======= 22:42:53 (1746067373) writemany pid 18477 Failing ost1 on oleg204-server Stopping /mnt/lustre-ost1 (opts:) on oleg204-server 22:43:06 (1746067386) shut down facet: ost1 facet_host: oleg204-server facet_failover_host: oleg204-server Failover ost1 to oleg204-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg204-server: oleg204-server.virtnet: executing set_default_debug -1 all pdsh@oleg204-client: oleg204-server: ssh exited with exit code 1 Started lustre-OST0000 22:43:22 (1746067402) targets are mounted 22:43:22 (1746067402) facet_failover done oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 19553 Failing ost1 on oleg204-server Stopping /mnt/lustre-ost1 (opts:) on oleg204-server 22:48:37 (1746067717) shut down facet: ost1 facet_host: oleg204-server facet_failover_host: oleg204-server Failover ost1 to oleg204-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg204-server: oleg204-server.virtnet: executing set_default_debug -1 all pdsh@oleg204-client: oleg204-server: ssh exited with exit code 1 Started lustre-OST0000 22:48:52 (1746067732) targets are mounted 22:48:52 (1746067732) facet_failover done oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 20630 Failing ost1 on oleg204-server Stopping /mnt/lustre-ost1 (opts:) on oleg204-server 22:54:08 (1746068048) shut down facet: ost1 facet_host: oleg204-server facet_failover_host: oleg204-server Failover ost1 to oleg204-server mount facets: ost1 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg204-server: oleg204-server.virtnet: executing set_default_debug -1 all pdsh@oleg204-client: oleg204-server: ssh exited with exit code 1 Started lustre-OST0000 22:54:24 (1746068064) targets are mounted 22:54:24 (1746068064) facet_failover done oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg204-client.virtnet oleg204-client.virtnet