== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 01:49:57 (1790920197) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 1792 2206848 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 4096 3765248 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 6144 7532544 1% /mnt/lustre total: 500 open/close in 8.52 seconds: 58.66 ops/second total: 500 open/close in 9.31 seconds: 53.71 ops/second total: 500 open/close in 7.66 seconds: 65.28 ops/second total: 500 open/close in 6.54 seconds: 76.42 ops/second total: 500 open/close in 6.16 seconds: 81.16 ops/second total: 500 open/close in 6.39 seconds: 78.23 ops/second total: 500 open/close in 6.87 seconds: 72.81 ops/second total: 500 open/close in 6.84 seconds: 73.09 ops/second total: 500 open/close in 6.89 seconds: 72.62 ops/second total: 500 open/close in 7.47 seconds: 66.90 ops/second Failing ost1 on oleg654-server Stopping /mnt/lustre-ost1 (opts:) on oleg654-server 01:51:57 (1790920317) shut down facet: ost1 facet_host: oleg654-server facet_failover_host: oleg654-server Failover ost1 to oleg654-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg654-server: oleg654-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg654-client: oleg654-server: ssh exited with exit code 1 Started lustre-OST0000 01:52:22 (1790920342) targets are mounted 01:52:22 (1790920342) facet_failover done starting wait for ls -l