== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 12:34:00 (1788971640)
UUID                   1K-blocks        Used   Available Use% Mounted on 
lustre-MDT0000_UUID      1414116        1832     1269472   1% /mnt/lustre[MDT:0] 
lustre-MDT0001_UUID      1414116        1648     1269656   1% /mnt/lustre[MDT:1] 
lustre-OST0000_UUID      3833116        2592     3604428   1% /mnt/lustre[OST:0] 
lustre-OST0001_UUID      3833116        1544     3605476   1% /mnt/lustre[OST:1] 

filesystem_summary:      7666232        4136     7209904   1% /mnt/lustre 

 - open/close 481 (time 1788971666.50 total 10.01 last 48.05)
total: 500 open/close in 10.39 seconds: 48.12 ops/second
total: 500 open/close in 9.38 seconds: 53.31 ops/second
total: 500 open/close in 7.65 seconds: 65.35 ops/second
total: 500 open/close in 6.66 seconds: 75.11 ops/second
 - open/close 495 (time 1788971721.10 total 10.00 last 49.49)
total: 500 open/close in 10.15 seconds: 49.25 ops/second
total: 500 open/close in 8.88 seconds: 56.30 ops/second
total: 500 open/close in 7.46 seconds: 67.04 ops/second
total: 500 open/close in 7.70 seconds: 64.96 ops/second
total: 500 open/close in 7.02 seconds: 71.19 ops/second
total: 500 open/close in 7.86 seconds: 63.59 ops/second
Failing ost1 on oleg414-server
Stopping /mnt/lustre-ost1 (opts:) on oleg414-server
12:36:29 (1788971789) shut down
facet: ost1 facet_host: oleg414-server facet_failover_host: oleg414-server
Failover ost1 to oleg414-server
mount facets: ost1
Start ost1: mount -t lustre -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg414-server: oleg414-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg414-client: oleg414-server: ssh exited with exit code 1
Started lustre-OST0000
12:37:04 (1788971824) targets are mounted
12:37:04 (1788971824) facet_failover done
starting wait for ls -l