== replay-ost-single test 12b: write after OST failover to a missing object ========================================================== 15:38:33 (1789673913) striped dir -i0 -c2 -H crush /mnt/lustre/d12b.replay-ost-single UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2196 1269108 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2020 1269284 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 7.51 seconds: 66.61 ops/second total: 500 open/close in 6.38 seconds: 78.36 ops/second total: 500 open/close in 6.77 seconds: 73.85 ops/second total: 500 open/close in 6.24 seconds: 80.09 ops/second total: 500 open/close in 6.74 seconds: 74.16 ops/second total: 500 open/close in 7.11 seconds: 70.31 ops/second total: 500 open/close in 7.07 seconds: 70.70 ops/second total: 500 open/close in 6.53 seconds: 76.58 ops/second total: 500 open/close in 7.65 seconds: 65.37 ops/second total: 500 open/close in 7.10 seconds: 70.40 ops/second fail_loc=0x16e fail_val=10 Failing ost1 on oleg336-server Stopping /mnt/lustre-ost1 (opts:) on oleg336-server 15:40:36 (1789674036) shut down facet: ost1 facet_host: oleg336-server facet_failover_host: oleg336-server Failover ost1 to oleg336-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg336-server: oleg336-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg336-client: oleg336-server: ssh exited with exit code 1 Started lustre-OST0000 15:41:06 (1789674066) targets are mounted 15:41:06 (1789674066) facet_failover done 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0130486 s, 314 kB/s