== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 10:25:32 (1782224732) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1832 1269472 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1648 1269656 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 7.53 seconds: 66.38 ops/second total: 500 open/close in 7.82 seconds: 63.93 ops/second total: 500 open/close in 7.96 seconds: 62.85 ops/second total: 500 open/close in 7.59 seconds: 65.84 ops/second total: 500 open/close in 6.97 seconds: 71.77 ops/second total: 500 open/close in 7.51 seconds: 66.54 ops/second total: 500 open/close in 8.38 seconds: 59.70 ops/second - open/close 489 (time 1782224837.26 total 10.02 last 48.79) total: 500 open/close in 10.24 seconds: 48.85 ops/second total: 500 open/close in 8.13 seconds: 61.52 ops/second total: 500 open/close in 8.25 seconds: 60.59 ops/second Failing ost1 on oleg453-server Stopping /mnt/lustre-ost1 (opts:) on oleg453-server 10:27:53 (1782224873) shut down facet: ost1 facet_host: oleg453-server facet_failover_host: oleg453-server Failover ost1 to oleg453-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg453-server: oleg453-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg453-client: oleg453-server: ssh exited with exit code 1 Started lustre-OST0000 10:28:24 (1782224904) targets are mounted 10:28:24 (1782224904) facet_failover done starting wait for ls -l