== replay-ost-single test 12a: glimpse after OST failover to a missing object ========================================================== 22:02:18 (1789264938) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1832 1269472 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1648 1269656 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 4.07 seconds: 122.91 ops/second total: 500 open/close in 5.92 seconds: 84.42 ops/second - open/close 384 (time 1789264970.33 total 10.00 last 38.39) total: 500 open/close in 12.83 seconds: 38.97 ops/second - open/close 283 (time 1789264990.34 total 10.01 last 28.28) total: 500 open/close in 14.58 seconds: 34.30 ops/second - open/close 391 (time 1789265010.90 total 10.02 last 39.04) total: 500 open/close in 13.07 seconds: 38.25 ops/second total: 500 open/close in 7.41 seconds: 67.49 ops/second total: 500 open/close in 6.04 seconds: 82.78 ops/second total: 500 open/close in 8.54 seconds: 58.55 ops/second total: 500 open/close in 8.72 seconds: 57.32 ops/second - open/close 488 (time 1789265081.43 total 10.00 last 48.80) total: 500 open/close in 10.24 seconds: 48.81 ops/second Failing ost1 on oleg132-server Stopping /mnt/lustre-ost1 (opts:) on oleg132-server 22:04:50 (1789265090) shut down facet: ost1 facet_host: oleg132-server facet_failover_host: oleg132-server Failover ost1 to oleg132-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg132-server: oleg132-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg132-client: oleg132-server: ssh exited with exit code 1 Started lustre-OST0000 22:05:20 (1789265120) targets are mounted 22:05:20 (1789265120) facet_failover done starting wait for ls -l