== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 09:27:27 (1789133247)
UUID                   1K-blocks        Used   Available Use%  Mounted on
lustre-MDT0000_UUID      1414116        1832     1269472   1%  /mnt/lustre[MDT:0] 
lustre-MDT0001_UUID      1414116        1648     1269656   1%  /mnt/lustre[MDT:1] 
lustre-OST0000_UUID      3833116        2596     3604392   1%  /mnt/lustre[OST:0] 
lustre-OST0001_UUID      3833116        1548     3605472   1%  /mnt/lustre[OST:1] 

filesystem_summary:      7666232        4144     7209864   1%  /mnt/lustre 

total: 500 open/close in 6.90 seconds: 72.43 ops/second
total: 500 open/close in 6.30 seconds: 79.33 ops/second
total: 500 open/close in 6.59 seconds: 75.85 ops/second
total: 500 open/close in 6.46 seconds: 77.44 ops/second
total: 500 open/close in 6.32 seconds: 79.16 ops/second
total: 500 open/close in 8.34 seconds: 59.97 ops/second
total: 500 open/close in 7.32 seconds: 68.33 ops/second
total: 500 open/close in 6.97 seconds: 71.75 ops/second
total: 500 open/close in 6.84 seconds: 73.15 ops/second
total: 500 open/close in 7.01 seconds: 71.33 ops/second
Failing ost1 on oleg333-server
Stopping /mnt/lustre-ost1 (opts:) on oleg333-server
09:29:29 (1789133369) shut down
facet: ost1 facet_host: oleg333-server facet_failover_host: oleg333-server
Failover ost1 to oleg333-server
mount facets: ost1
Start ost1: mount -t lustre -o localrecov  /dev/mapper/ost1_flakey /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg333-server: oleg333-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg333-client: oleg333-server: ssh exited with exit code 1
Started lustre-OST0000
09:29:58 (1789133398) targets are mounted
09:29:58 (1789133398) facet_failover done
starting wait for ls -l