== recovery-small test 52: failover OST under load ======= 03:43:09 (1711093389) writemany pid 23828 Failing ost1 on oleg158-server Stopping /mnt/lustre-ost1 (opts:) on oleg158-server 03:43:21 (1711093401) shut down Failover ost1 to oleg158-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Started lustre-OST0000 03:43:34 (1711093414) targets are mounted 03:43:34 (1711093414) facet_failover done oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 24899 Failing ost1 on oleg158-server Stopping /mnt/lustre-ost1 (opts:) on oleg158-server 03:48:55 (1711093735) shut down Failover ost1 to oleg158-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Started lustre-OST0000 03:49:12 (1711093752) targets are mounted 03:49:12 (1711093752) facet_failover done oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded writemany pid 25980 Failing ost1 on oleg158-server Stopping /mnt/lustre-ost1 (opts:) on oleg158-server 03:54:25 (1711094065) shut down Failover ost1 to oleg158-server mount facets: ost1 Starting ost1: -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg158-server: oleg158-server.virtnet: executing set_default_debug -1 all pdsh@oleg158-client: oleg158-server: ssh exited with exit code 1 Started lustre-OST0000 03:54:44 (1711094084) targets are mounted 03:54:44 (1711094084) facet_failover done oleg158-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec writemany succeeded Connected clients: oleg158-client.virtnet oleg158-client.virtnet