== replay-ost-single test 12b: write after OST failover to a missing object ========================================================== 09:03:29 (1790946209) striped dir -i0 -c2 -H crush /mnt/lustre/d12b.replay-ost-single UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2196 1269108 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2020 1269284 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre total: 500 open/close in 6.37 seconds: 78.48 ops/second total: 500 open/close in 5.53 seconds: 90.35 ops/second total: 500 open/close in 5.10 seconds: 98.08 ops/second total: 500 open/close in 6.47 seconds: 77.33 ops/second total: 500 open/close in 5.61 seconds: 89.05 ops/second total: 500 open/close in 5.27 seconds: 94.86 ops/second total: 500 open/close in 5.22 seconds: 95.73 ops/second total: 500 open/close in 5.39 seconds: 92.82 ops/second total: 500 open/close in 5.35 seconds: 93.48 ops/second total: 500 open/close in 5.68 seconds: 88.11 ops/second fail_loc=0x16e fail_val=10 Failing ost1 on oleg311-server Stopping /mnt/lustre-ost1 (opts:) on oleg311-server 09:05:10 (1790946310) shut down facet: ost1 facet_host: oleg311-server facet_failover_host: oleg311-server Failover ost1 to oleg311-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg311-server: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg311-client: oleg311-server: ssh exited with exit code 1 Started lustre-OST0000 09:05:39 (1790946339) targets are mounted 09:05:39 (1790946339) facet_failover done 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00399813 s, 1.0 MB/s