== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 04:48:21 (1788511701) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 9.32 seconds: 53.66 ops/second total: 500 open/close in 9.41 seconds: 53.14 ops/second total: 500 open/close in 7.48 seconds: 66.84 ops/second - open/close 387 (time 1788511766.67 total 10.04 last 38.56) total: 500 open/close in 13.22 seconds: 37.84 ops/second - open/close 369 (time 1788511785.88 total 10.00 last 36.90) total: 500 open/close in 13.24 seconds: 37.77 ops/second total: 500 open/close in 8.06 seconds: 62.06 ops/second total: 500 open/close in 9.12 seconds: 54.85 ops/second - open/close 463 (time 1788511832.28 total 10.01 last 46.28) total: 500 open/close in 10.99 seconds: 45.50 ops/second - open/close 483 (time 1788511849.49 total 10.04 last 48.10) total: 500 open/close in 10.49 seconds: 47.65 ops/second total: 500 open/close in 9.42 seconds: 53.09 ops/second Failing ost1 on oleg206-server Stopping /mnt/lustre-ost1 (opts:) on oleg206-server 04:51:15 (1788511875) shut down facet: ost1 facet_host: oleg206-server facet_failover_host: oleg206-server Failover ost1 to oleg206-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg206-server: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg206-client: oleg206-server: ssh exited with exit code 1 Started lustre-OST0000 04:51:46 (1788511906) targets are mounted 04:51:46 (1788511906) facet_failover done starting wait for ls -l