== sanity-quota test 7c: Quota reintegration (restart mds during reintegration) ========================================================== 05:03:06 (1743498186) sleep 5 for ZFS MDS Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 -u quota_usr space:0 fail_val=0 fail_loc=0xa03 osd-zfs.lustre-OST0000.quota_slave.force_reint=1 osd-zfs.lustre-OST0001.quota_slave.force_reint=1 Stop mds... Stopping /mnt/lustre-mds1 (opts:) on oleg658-server fail_val=0 fail_loc=0 Start mds... Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg658-server: oleg658-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg658-client: oleg658-server: ssh exited with exit code 1 Started lustre-MDT0000 affected facets: ost1 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg658-server: *.lustre-OST0000.recovery_status status: COMPLETE Waiting 200s for 'glb[1],slv[1],reint[0]' Waiting 160s for 'glb[1],slv[1],reint[0]' Waiting 140s for 'glb[1],slv[1],reint[0]' Waiting 130s for 'glb[1],slv[1],reint[0]' Updated after 77s: want 'glb[1],slv[1],reint[0]' got 'glb[1],slv[1],reint[0]' affected facets: ost2 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg658-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg658-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg658-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg658-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg658-server: oleg658-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg658-server: *.lustre-OST0001.recovery_status status: INACTIVE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota] [count=6] [oflag=sync] dd: error writing '/mnt/lustre/d7c.sanity-quota/f7c.sanity-quota': Disk quota exceeded 5+0 records in 4+0 records out 4194304 bytes (4.2 MB, 4.0 MiB) copied, 2.19863 s, 1.9 MB/s Delete files... Wait for unlink objects finished... sleep 5 for ZFS MDS Waiting for MDT destroys to complete