== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 00:35:34 (1734672934)
sleep 5 for ZFS MDS
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
Disk quotas for usr quota_usr (uid 60000):
      Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace
     /mnt/lustre       0       0       0       -       0       0       0       -
  lustre-MDT0000       0       -       0       -       0       -       0       -
  lustre-OST0000       0       -       0       -       -       -       -       -
  lustre-OST0001       0       -       0       -       -       -       -       -
Total allocated inode limit: 0, total allocated block limit: 0
Waiting 90s for 'none'
fail_val=0
fail_loc=0xa03
Waiting 90s for 'ugp'
Updated after 2s: want 'ugp' got 'ugp'
osd-zfs.lustre-OST0000.quota_slave.force_reint=1
osd-zfs.lustre-OST0001.quota_slave.force_reint=1
Stop mds...
Stopping /mnt/lustre-mds1 (opts:) on oleg157-server
fail_val=0
fail_loc=0
Start mds...
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg157-server: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg157-client: oleg157-server: ssh exited with exit code 1
Started lustre-MDT0000
affected facets: ost1
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg157-server: *.lustre-OST0000.recovery_status status: COMPLETE
Waiting 200s for 'glb[1],slv[1],reint[0]'
Waiting 190s for 'glb[1],slv[1],reint[0]'
Waiting 180s for 'glb[1],slv[1],reint[0]'
Waiting 160s for 'glb[1],slv[1],reint[0]'
Waiting 140s for 'glb[1],slv[1],reint[0]'
Waiting 130s for 'glb[1],slv[1],reint[0]'
Waiting 110s for 'glb[1],slv[1],reint[0]'
Waiting 100s for 'glb[1],slv[1],reint[0]'
Updated after 105s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]'
affected facets: ost2
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg157-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg157-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg157-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg157-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg157-server: oleg157-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg157-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync]
dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded
5+0 records in
4+0 records out
5218304 bytes (5.2 MB) copied, 7.92338 s, 659 kB/s
Delete files...
Wait for unlink objects finished...
sleep 5 for ZFS MDS
sleep 5 for ZFS OST
Waiting for MDT destroys to complete