== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 23:48:39 (1788839319) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 5120 7533568 1% /mnt/lustre total: 500 open/close in 8.79 seconds: 56.88 ops/second total: 500 open/close in 7.77 seconds: 64.33 ops/second total: 500 open/close in 8.79 seconds: 56.91 ops/second total: 500 open/close in 8.51 seconds: 58.74 ops/second total: 500 open/close in 8.99 seconds: 55.63 ops/second total: 500 open/close in 7.66 seconds: 65.30 ops/second - open/close 462 (time 1788839414.02 total 10.00 last 46.18) total: 500 open/close in 11.21 seconds: 44.61 ops/second total: 500 open/close in 8.21 seconds: 60.92 ops/second total: 500 open/close in 9.07 seconds: 55.15 ops/second total: 500 open/close in 8.11 seconds: 61.62 ops/second Failing ost1 on oleg407-server Stopping /mnt/lustre-ost1 (opts:) on oleg407-server 23:51:04 (1788839464) shut down facet: ost1 facet_host: oleg407-server facet_failover_host: oleg407-server Failover ost1 to oleg407-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg407-server: oleg407-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg407-client: oleg407-server: ssh exited with exit code 1 Started lustre-OST0000 23:51:32 (1788839492) targets are mounted 23:51:32 (1788839492) facet_failover done starting wait for ls -l