== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 03:30:24 (1788852624) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 8.28 seconds: 60.37 ops/second total: 500 open/close in 9.10 seconds: 54.95 ops/second total: 500 open/close in 8.54 seconds: 58.57 ops/second - open/close 478 (time 1788852682.97 total 10.02 last 47.71) total: 500 open/close in 10.55 seconds: 47.38 ops/second - open/close 397 (time 1788852699.38 total 10.02 last 39.64) total: 500 open/close in 12.66 seconds: 39.50 ops/second - open/close 339 (time 1788852719.90 total 10.01 last 33.85) total: 500 open/close in 13.49 seconds: 37.07 ops/second total: 500 open/close in 9.54 seconds: 52.39 ops/second total: 500 open/close in 8.44 seconds: 59.27 ops/second total: 500 open/close in 9.55 seconds: 52.35 ops/second total: 500 open/close in 8.53 seconds: 58.59 ops/second Failing ost1 on oleg422-server Stopping /mnt/lustre-ost1 (opts:) on oleg422-server 03:33:09 (1788852789) shut down facet: ost1 facet_host: oleg422-server facet_failover_host: oleg422-server Failover ost1 to oleg422-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg422-server: oleg422-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg422-client: oleg422-server: ssh exited with exit code 1 Started lustre-OST0000 03:33:38 (1788852818) targets are mounted 03:33:38 (1788852818) facet_failover done starting wait for ls -l