== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 02:01:59 (1724306519)
sleep 5 for ZFS zfs
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
Disk quotas for usr quota_usr (uid 60000):
      Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace
     /mnt/lustre       0       0       0       -       0       0       0       -
  lustre-MDT0000       0       -       0       -       0       -       0       -
  lustre-OST0000       0       -       0       -       -       -       -       -
  lustre-OST0001       0       -       0       -       -       -       -       -
Total allocated inode limit: 0, total allocated block limit: 0
Waiting 90s for 'none'
fail_val=0
fail_loc=0xa03
Waiting 90s for 'ugp'
osd-zfs.lustre-OST0000.quota_slave.force_reint=1
osd-zfs.lustre-OST0001.quota_slave.force_reint=1
Stop mds...
Stopping /mnt/lustre-mds1 (opts:) on oleg350-server
fail_val=0
fail_loc=0
Start mds...
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg350-server: oleg350-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg350-client: oleg350-server: ssh exited with exit code 1
Started lustre-MDT0000
affected facets: ost1
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg350-server: *.lustre-OST0000.recovery_status status: COMPLETE
Waiting 200s for 'glb[1],slv[1],reint[0]'
Waiting 190s for 'glb[1],slv[1],reint[0]'
Waiting 180s for 'glb[1],slv[1],reint[0]'
Waiting 160s for 'glb[1],slv[1],reint[0]'
Waiting 130s for 'glb[1],slv[1],reint[0]'
Waiting 120s for 'glb[1],slv[1],reint[0]'
Updated after 107s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]'
affected facets: ost2
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg350-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg350-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg350-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg350-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg350-server: oleg350-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg350-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync]
dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded
5+0 records in
4+0 records out
5218304 bytes (5.2 MB) copied, 9.30486 s, 561 kB/s
Delete files...
Wait for unlink objects finished...
sleep 5 for ZFS zfs
sleep 5 for ZFS zfs
Waiting for MDT destroys to complete