== replay-ost-single test 12b: write after OST failover to a missing object ========================================================== 13:37:50 (1761241070)
striped dir -i0 -c2 -H crush /mnt/lustre/d12b.replay-ost-single
UUID                   1K-blocks        Used   Available Use% Mounted on
lustre-MDT0000_UUID      2210688        3328     2205312   1% /mnt/lustre[MDT:0]
lustre-MDT0001_UUID      2210688        3328     2205312   1% /mnt/lustre[MDT:1]
lustre-OST0000_UUID      3771392        5120     3764224   1% /mnt/lustre[OST:0]
lustre-OST0001_UUID      3771392        3072     3766272   1% /mnt/lustre[OST:1]

filesystem_summary:      7542784        8192     7530496   1% /mnt/lustre

total: 500 open/close in 6.42 seconds: 77.87 ops/second
total: 500 open/close in 6.88 seconds: 72.70 ops/second
total: 500 open/close in 8.10 seconds: 61.75 ops/second
total: 500 open/close in 6.42 seconds: 77.83 ops/second
total: 500 open/close in 7.17 seconds: 69.71 ops/second
total: 500 open/close in 7.21 seconds: 69.34 ops/second
total: 500 open/close in 6.79 seconds: 73.64 ops/second
total: 500 open/close in 6.72 seconds: 74.38 ops/second
open(/mnt/lustre/d12b.replay-ost-single/d9/file0) error: No space left on device
total: 0 open/close in 40.58 seconds: 0.00 ops/second
open(/mnt/lustre/d12b.replay-ost-single/d10/file0) error: No space left on device
total: 0 open/close in 40.84 seconds: 0.00 ops/second
fail_loc=0x16e
fail_val=10
Failing ost1 on oleg335-server
Stopping /mnt/lustre-ost1 (opts:) on oleg335-server
reboot facets: ost1
Failover ost1 to oleg335-server
mount facets: ost1
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
oleg335-server: oleg335-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg335-client: oleg335-server: ssh exited with exit code 1
Started lustre-OST0000
dd: failed to open '/mnt/lustre/d12b.replay-ost-single/d10/file499': No space left on device
 replay-ost-single test_12b: @@@@@@ FAIL: dd failed: 1 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6459:error()
  = /home/green/git/lustre-release/lustre/tests/replay-ost-single.sh:490:test_12b()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6817:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6864:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6705:run_test()
  = /home/green/git/lustre-release/lustre/tests/replay-ost-single.sh:494:main()
Dumping lctl log to /tmp/testlogs//replay-ost-single.test_12b.*.1761241315.log
rsync: chown "/tmp/testlogs/.replay-ost-single.test_12b.debug_log.oleg335-server.1761241315.log.cwDJwA" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.replay-ost-single.test_12b.dmesg.oleg335-server.1761241315.log.J9d3mD" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]