== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 23:32:59 (1781235179) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1724 1269580 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3833116 2440 3604580 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1408 3605612 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3848 7210192 1% /mnt/lustre total: 500 open/close in 8.91 seconds: 56.13 ops/second total: 500 open/close in 8.17 seconds: 61.18 ops/second total: 500 open/close in 7.63 seconds: 65.50 ops/second total: 500 open/close in 8.30 seconds: 60.23 ops/second total: 500 open/close in 9.37 seconds: 53.37 ops/second total: 500 open/close in 8.30 seconds: 60.21 ops/second total: 500 open/close in 8.40 seconds: 59.52 ops/second total: 500 open/close in 8.83 seconds: 56.62 ops/second - open/close 496 (time 1781235305.08 total 10.00 last 49.59) total: 500 open/close in 10.04 seconds: 49.78 ops/second total: 500 open/close in 7.44 seconds: 67.16 ops/second Failing ost1 on oleg446-server Stopping /mnt/lustre-ost1 (opts:) on oleg446-server 23:35:23 (1781235323) shut down facet: ost1 facet_host: oleg446-server facet_failover_host: oleg446-server Failover ost1 to oleg446-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 23:35:55 (1781235355) targets are mounted 23:35:55 (1781235355) facet_failover done starting wait for ls -l