== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 16:31:26 (1785789086) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 7.47 seconds: 66.94 ops/second total: 500 open/close in 9.85 seconds: 50.78 ops/second - open/close 487 (time 1785789135.73 total 10.02 last 48.63) total: 500 open/close in 10.34 seconds: 48.35 ops/second total: 500 open/close in 6.55 seconds: 76.32 ops/second total: 500 open/close in 8.84 seconds: 56.55 ops/second total: 500 open/close in 8.96 seconds: 55.78 ops/second total: 500 open/close in 9.44 seconds: 52.98 ops/second - open/close 494 (time 1785789203.87 total 10.01 last 49.37) total: 500 open/close in 10.14 seconds: 49.33 ops/second total: 500 open/close in 8.80 seconds: 56.85 ops/second - open/close 466 (time 1785789232.68 total 10.02 last 46.53) total: 500 open/close in 10.49 seconds: 47.68 ops/second Failing ost1 on oleg405-server Stopping /mnt/lustre-ost1 (opts:) on oleg405-server 16:34:00 (1785789240) shut down facet: ost1 facet_host: oleg405-server facet_failover_host: oleg405-server Failover ost1 to oleg405-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg405-server: oleg405-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg405-client: oleg405-server: ssh exited with exit code 1 Started lustre-OST0000 16:34:26 (1785789266) targets are mounted 16:34:26 (1785789266) facet_failover done starting wait for ls -l