== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 09:51:58 (1788529918) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 7.96 seconds: 62.82 ops/second total: 500 open/close in 8.87 seconds: 56.37 ops/second - open/close 490 (time 1788529963.60 total 10.01 last 48.94) total: 500 open/close in 10.21 seconds: 48.96 ops/second total: 500 open/close in 9.56 seconds: 52.31 ops/second total: 500 open/close in 8.96 seconds: 55.78 ops/second - open/close 499 (time 1788530008.56 total 10.01 last 49.86) total: 500 open/close in 10.01 seconds: 49.96 ops/second - open/close 498 (time 1788530024.08 total 10.00 last 49.79) total: 500 open/close in 10.01 seconds: 49.93 ops/second total: 500 open/close in 8.09 seconds: 61.77 ops/second total: 500 open/close in 9.58 seconds: 52.22 ops/second total: 500 open/close in 7.93 seconds: 63.04 ops/second Failing ost1 on oleg401-server Stopping /mnt/lustre-ost1 (opts:) on oleg401-server 09:54:32 (1788530072) shut down facet: ost1 facet_host: oleg401-server facet_failover_host: oleg401-server Failover ost1 to oleg401-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg401-server: oleg401-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg401-client: oleg401-server: ssh exited with exit code 1 Started lustre-OST0000 09:54:57 (1788530097) targets are mounted 09:54:57 (1788530097) facet_failover done starting wait for ls -l