== replay-ost-single test 7: Fail OST before obd_destroy ========================================================== 16:34:41 (1788726881) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg605-server mds-ost sync done. Waiting for MDT destroys to complete 1280+0 records in 1280+0 records out 5242880 bytes (5.2 MB, 5.0 MiB) copied, 1.38497 s, 3.8 MB/s before: 7538688 after_dd: 7534592 took 0 seconds UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3758080 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7525376 1% /mnt/lustre Failing ost1 on oleg605-server Stopping /mnt/lustre-ost1 (opts:) on oleg605-server 16:35:05 (1788726905) shut down facet: ost1 facet_host: oleg605-server facet_failover_host: oleg605-server Failover ost1 to oleg605-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg605-server: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg605-client: oleg605-server: ssh exited with exit code 1 Started lustre-OST0000 16:35:29 (1788726929) targets are mounted 16:35:29 (1788726929) facet_failover done oleg605-client.virtnet: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec affected facets: ost1 oleg605-server: oleg605-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg605-server: *.lustre-OST0000.recovery_status status: COMPLETE Can't lstat /mnt/lustre/d0.replay-ost-single/f7.replay-ost-single: No such file or directory Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg605-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete before: 7538688 after: 7538688