== recovery-small test 52: failover OST under load ======= 16:21:47 (1710102107) writemany pid 23990 Failing ost1 on oleg112-server Stopping /mnt/lustre-ost1 (opts:) on oleg112-server 16:22:02 (1710102122) shut down Failover ost1 to oleg112-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg112-server: oleg112-server.virtnet: executing set_default_debug -1 all pdsh@oleg112-client: oleg112-server: ssh exited with exit code 1 Started lustre-OST0000 16:22:22 (1710102142) targets are mounted 16:22:22 (1710102142) facet_failover done oleg112-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 25064 Failing ost1 on oleg112-server Stopping /mnt/lustre-ost1 (opts:) on oleg112-server 16:27:33 (1710102453) shut down Failover ost1 to oleg112-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg112-server: oleg112-server.virtnet: executing set_default_debug -1 all pdsh@oleg112-client: oleg112-server: ssh exited with exit code 1 Started lustre-OST0000 16:27:54 (1710102474) targets are mounted 16:27:54 (1710102474) facet_failover done oleg112-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 26141 Failing ost1 on oleg112-server Stopping /mnt/lustre-ost1 (opts:) on oleg112-server 16:33:06 (1710102786) shut down Failover ost1 to oleg112-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg112-server: oleg112-server.virtnet: executing set_default_debug -1 all pdsh@oleg112-client: oleg112-server: ssh exited with exit code 1 Started lustre-OST0000 16:33:26 (1710102806) targets are mounted 16:33:26 (1710102806) facet_failover done oleg112-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg112-client.virtnet oleg112-client.virtnet