== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 08:58:35 (1785934715) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1832 1269472 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1648 1269656 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 6.81 seconds: 73.38 ops/second total: 500 open/close in 7.76 seconds: 64.45 ops/second total: 500 open/close in 8.60 seconds: 58.14 ops/second total: 500 open/close in 8.66 seconds: 57.75 ops/second total: 500 open/close in 7.52 seconds: 66.53 ops/second total: 500 open/close in 8.47 seconds: 59.05 ops/second - open/close 453 (time 1785934818.29 total 10.01 last 45.27) total: 500 open/close in 11.02 seconds: 45.39 ops/second total: 500 open/close in 5.09 seconds: 98.18 ops/second total: 500 open/close in 9.04 seconds: 55.31 ops/second total: 500 open/close in 7.53 seconds: 66.39 ops/second Failing ost1 on oleg257-server Stopping /mnt/lustre-ost1 (opts:) on oleg257-server 09:01:04 (1785934864) shut down facet: ost1 facet_host: oleg257-server facet_failover_host: oleg257-server Failover ost1 to oleg257-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg257-server: oleg257-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg257-client: oleg257-server: ssh exited with exit code 1 Started lustre-OST0000 09:01:43 (1785934903) targets are mounted 09:01:43 (1785934903) facet_failover done starting wait for ls -l