== sanity-quota test 7a: Quota reintegration (global index) ========================================================== 23:23:54 (1735100634) sleep 5 for ZFS MDS Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting 90s for 'none' Updated after 2s: want 'none' got 'none' Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Stop ost1... Stopping /mnt/lustre-ost1 (opts:) on oleg344-server Enable quota & set quota limit for quota_usr Waiting 90s for 'ugp' Updated after 2s: want 'ugp' got 'ugp' Start ost1... Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota] [count=6] [oflag=sync] dd: error writing '/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota': Disk quota exceeded 5+0 records in 4+0 records out 5218304 bytes (5.2 MB) copied, 2.94568 s, 1.8 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Stop ost1... Stopping /mnt/lustre-ost1 (opts:) on oleg344-server Start ost1... Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 seq.cli-lustre-OST0000-super.width=65536 oleg344-server: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all pdsh@oleg344-client: oleg344-server: ssh exited with exit code 1 Started lustre-OST0000 affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1470 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1465 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1460 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1455 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1450 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1445 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1440 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1435 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1430 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1425 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1420 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1415 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1410 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: RECOVERING oleg344-server: Waiting 1405 secs for *.lustre-OST0000.recovery_status recovery done. status: RECOVERING oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE affected facets: ost1 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0000.recovery_status 1475 oleg344-server: *.lustre-OST0000.recovery_status status: COMPLETE affected facets: ost2 oleg344-server: oleg344-server.virtnet: executing _wait_recovery_complete *.lustre-OST0001.recovery_status 1475 oleg344-server: *.lustre-OST0001.recovery_status status: INACTIVE running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d7a.sanity-quota/f7a.sanity-quota] [count=6] [oflag=sync] 6+0 records in 6+0 records out 6291456 bytes (6.3 MB) copied, 0.42526 s, 14.8 MB/s Delete files... Wait for unlink objects finished... sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete