== sanity-quota test 16c: lfs quota should preserve usage with an unavailable OST ========================================================== 22:52:43 (1788749563)
sleep 5 for ZFS MDS
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000
 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d16c.sanity-quota/f16c.sanity-quota] [count=50] [oflag=sync]
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 14.1745 s, 3.7 MB/s
Stopping /mnt/lustre-ost1 (opts:) on oleg429-server
Stopping client oleg429-client.virtnet /mnt/lustre (opts:)
Starting client: oleg429-client.virtnet:  -o user_xattr,flock 192.168.204.129@tcp:/lustre /mnt/lustre
oleg429-client.virtnet: executing wait_import_state (DISCONN|IDLE) osc.lustre-OST0000-osc-ffff8b5b86f25000.ost_server_uuid 50
osc.lustre-OST0000-osc-ffff8b5b86f25000.ost_server_uuid in DISCONN state after 0 sec
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg429-server: oleg429-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg429-client: oleg429-server: ssh exited with exit code 1
Started lustre-OST0000
affected facets: ost1
oleg429-server: oleg429-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1470 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1465 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1460 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1455 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1450 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1445 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1440 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1435 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1430 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1425 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1420 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1415 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1410 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1405 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1400 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1395 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1390 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: RECOVERING
oleg429-server: Waiting 1385 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING
oleg429-server: *.lustre-OST0000.recovery_status status: COMPLETE
192.168.204.129@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0
oleg429-server: oleg429-server.virtnet: executing wait_import_state FULL os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid 50
oleg429-server: os[cp].lustre-OST0000-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
oleg429-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8b5b86f25000.ost_server_uuid 50
osc.lustre-OST0000-osc-ffff8b5b86f25000.ost_server_uuid in FULL state after 0 sec
Delete files...
Wait for unlink objects finished...
sleep 5 for ZFS MDS
sleep 5 for ZFS OST
Waiting for MDT destroys to complete