== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 10:05:53 (1761314753)
sleep 5 for ZFS MDS
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
fail_val=0
fail_loc=0xa03
osd-zfs.lustre-OST0000.quota_slave.force_reint=1
osd-zfs.lustre-OST0001.quota_slave.force_reint=1
Stop mds...
Stopping /mnt/lustre-mds1 (opts:) on oleg230-server
fail_val=0
fail_loc=0
Start mds...
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg230-server: oleg230-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8
pdsh@oleg230-client: oleg230-server: ssh exited with exit code 1
Started lustre-MDT0000
affected facets: ost1
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg230-server: *.lustre-OST0000.recovery_status status: COMPLETE
Waiting 200s for 'glb[1],slv[1],reint[0]'
Waiting 170s for 'glb[1],slv[1],reint[0]'
Waiting 150s for 'glb[1],slv[1],reint[0]'
Waiting 140s for 'glb[1],slv[1],reint[0]'
Updated after 95s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]'
affected facets: ost2
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg230-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg230-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg230-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg230-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg230-server: oleg230-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg230-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync]
dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded
5+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 1.13041 s, 3.7 MB/s
Delete files...
Wait for unlink objects finished...
sleep 5 for ZFS MDS
sleep 5 for ZFS OST
Waiting for MDT destroys to complete