== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 05:22:21 (1726305741)
sleep 5 for ZFS zfs
Waiting for MDT destroys to complete
Creating test directory
fail_val=0
fail_loc=0
Disk quotas for usr quota_usr (uid 60000):
      Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace
     /mnt/lustre       0       0       0       -       0       0       0       -
  lustre-MDT0000       0       -       0       -       0       -       0       -
  lustre-OST0000       0       -       0       -       -       -       -       -
  lustre-OST0001       0       -       0       -       -       -       -       -
Total allocated inode limit: 0, total allocated block limit: 0
Waiting 90s for 'none'
Updated after 2s: want 'none' got 'none'
fail_val=0
fail_loc=0xa03
osd-zfs.lustre-OST0000.quota_slave.force_reint=1
osd-zfs.lustre-OST0001.quota_slave.force_reint=1
Stop mds...
Stopping /mnt/lustre-mds1 (opts:) on oleg441-server
fail_val=0
fail_loc=0
Start mds...
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg441-server: oleg441-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg441-client: oleg441-server: ssh exited with exit code 1
Started lustre-MDT0000
affected facets: ost1
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg441-server: *.lustre-OST0000.recovery_status status: COMPLETE
Waiting 200s for 'glb[1],slv[1],reint[0]'
Waiting 180s for 'glb[1],slv[1],reint[0]'
Waiting 170s for 'glb[1],slv[1],reint[0]'
Waiting 160s for 'glb[1],slv[1],reint[0]'
Waiting 150s for 'glb[1],slv[1],reint[0]'
Waiting 140s for 'glb[1],slv[1],reint[0]'
Waiting 130s for 'glb[1],slv[1],reint[0]'
Waiting 110s for 'glb[1],slv[1],reint[0]'
Waiting 100s for 'glb[1],slv[1],reint[0]'
Waiting 90s for 'glb[1],slv[1],reint[0]'
Updated after 113s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]'
affected facets: ost2
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg441-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg441-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg441-server: *.lustre-OST0001.recovery_status status: INACTIVE
affected facets: ost1
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475
oleg441-server: *.lustre-OST0000.recovery_status status: COMPLETE
affected facets: ost2
oleg441-server: oleg441-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475
oleg441-server: *.lustre-OST0001.recovery_status status: INACTIVE
running as uid/gid/euid/egid 60000/60000/60000/60000, groups:
 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync]
dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded
5+0 records in
4+0 records out
5218304 bytes (5.2 MB) copied, 2.89532 s, 1.8 MB/s
Delete files...
Wait for unlink objects finished...
sleep 5 for ZFS zfs
sleep 5 for ZFS zfs
Waiting for MDT destroys to complete