== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 02:40:22 (1787380822) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 7.65 seconds: 65.34 ops/second total: 500 open/close in 8.04 seconds: 62.20 ops/second total: 500 open/close in 7.85 seconds: 63.72 ops/second total: 500 open/close in 8.21 seconds: 60.93 ops/second total: 500 open/close in 7.74 seconds: 64.57 ops/second total: 500 open/close in 8.12 seconds: 61.56 ops/second - open/close 473 (time 1787380910.69 total 10.01 last 47.27) total: 500 open/close in 10.37 seconds: 48.20 ops/second total: 500 open/close in 8.88 seconds: 56.32 ops/second total: 500 open/close in 9.23 seconds: 54.17 ops/second total: 500 open/close in 8.82 seconds: 56.70 ops/second Failing ost1 on oleg444-server Stopping /mnt/lustre-ost1 (opts:) on oleg444-server 02:42:37 (1787380957) shut down facet: ost1 facet_host: oleg444-server facet_failover_host: oleg444-server Failover ost1 to oleg444-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg444-server: oleg444-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg444-client: oleg444-server: ssh exited with exit code 1 Started lustre-OST0000 02:43:01 (1787380981) targets are mounted 02:43:01 (1787380981) facet_failover done starting wait for ls -l