== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 09:52:44 (1773669164) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3200 2205440 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 3072 3766272 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 8192 7528448 1% /mnt/lustre total: 500 open/close in 2.91 seconds: 171.62 ops/second total: 500 open/close in 3.48 seconds: 143.79 ops/second - open/close 446 (time 1773669188.80 total 10.00 last 44.59) total: 500 open/close in 11.80 seconds: 42.37 ops/second total: 500 open/close in 9.87 seconds: 50.65 ops/second total: 500 open/close in 9.19 seconds: 54.39 ops/second - open/close 434 (time 1773669238.38 total 10.01 last 43.34) total: 500 open/close in 11.64 seconds: 42.97 ops/second - open/close 384 (time 1773669257.94 total 10.02 last 38.33) total: 500 open/close in 12.74 seconds: 39.25 ops/second total: 500 open/close in 7.64 seconds: 65.47 ops/second total: 500 open/close in 7.22 seconds: 69.27 ops/second total: 500 open/close in 7.31 seconds: 68.43 ops/second Failing ost1 on oleg419-server Stopping /mnt/lustre-ost1 (opts:) on oleg419-server 09:55:04 (1773669304) shut down facet: ost1 facet_host: oleg419-server facet_failover_host: oleg419-server Failover ost1 to oleg419-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg419-server: oleg419-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg419-client: oleg419-server: ssh exited with exit code 1 Started lustre-OST0000 09:55:27 (1773669327) targets are mounted 09:55:27 (1773669327) facet_failover done starting wait for ls -l