== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 01:51:01 (1785390661) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1832 1269472 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1648 1269656 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 4.30 seconds: 116.26 ops/second total: 500 open/close in 8.13 seconds: 61.53 ops/second total: 500 open/close in 7.56 seconds: 66.10 ops/second total: 500 open/close in 8.30 seconds: 60.28 ops/second - open/close 357 (time 1785390735.81 total 10.02 last 35.64) total: 500 open/close in 13.11 seconds: 38.14 ops/second - open/close 472 (time 1785390754.59 total 10.01 last 47.14) total: 500 open/close in 10.76 seconds: 46.48 ops/second total: 500 open/close in 7.78 seconds: 64.23 ops/second total: 500 open/close in 8.07 seconds: 61.94 ops/second - open/close 486 (time 1785390795.30 total 10.01 last 48.55) total: 500 open/close in 10.25 seconds: 48.77 ops/second total: 500 open/close in 8.42 seconds: 59.35 ops/second Failing ost1 on oleg446-server Stopping /mnt/lustre-ost1 (opts:) on oleg446-server 01:53:35 (1785390815) shut down facet: ost1 facet_host: oleg446-server facet_failover_host: oleg446-server Failover ost1 to oleg446-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg446-server: oleg446-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg446-client: oleg446-server: ssh exited with exit code 1 Started lustre-OST0000 01:54:16 (1785390856) targets are mounted 01:54:16 (1785390856) facet_failover done starting wait for ls -l