== replay-ost-single test 12b: write after OST failover to a missing object ========================================================== 03:17:19 (1785395839) striped dir -i0 -c2 -H crush /mnt/lustre/d12b.replay-ost-single UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 2196 1269108 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 2020 1269284 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 2592 3604428 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 4136 7209904 1% /mnt/lustre - open/close 486 (time 1785395867.08 total 10.01 last 48.53) total: 500 open/close in 10.29 seconds: 48.57 ops/second - open/close 467 (time 1785395885.01 total 10.02 last 46.59) total: 500 open/close in 11.14 seconds: 44.87 ops/second total: 500 open/close in 5.77 seconds: 86.70 ops/second total: 500 open/close in 8.60 seconds: 58.11 ops/second total: 500 open/close in 6.19 seconds: 80.75 ops/second total: 500 open/close in 7.00 seconds: 71.41 ops/second total: 500 open/close in 8.61 seconds: 58.08 ops/second - open/close 409 (time 1785395969.02 total 10.01 last 40.87) total: 500 open/close in 11.64 seconds: 42.95 ops/second total: 500 open/close in 7.83 seconds: 63.88 ops/second - open/close 419 (time 1785396003.33 total 10.01 last 41.84) total: 500 open/close in 12.16 seconds: 41.12 ops/second fail_loc=0x16e fail_val=10 Failing ost1 on oleg239-server Stopping /mnt/lustre-ost1 (opts:) on oleg239-server 03:20:17 (1785396017) shut down facet: ost1 facet_host: oleg239-server facet_failover_host: oleg239-server Failover ost1 to oleg239-server mount facets: ost1 Start ost1: mount -t lustre -o localrecov /dev/mapper/ost1_flakey /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg239-server: oleg239-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg239-client: oleg239-server: ssh exited with exit code 1 Started lustre-OST0000 03:20:56 (1785396056) targets are mounted 03:20:56 (1785396056) facet_failover done 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.080177 s, 51.1 kB/s