== sanity-quota test 48: lfs quota --delete should delete quota project ID ========================================================== 21:55:37 (1788314137) sleep 5 for ZFS MDS Waiting for MDT destroys to complete Creating test directory fail_val=0 fail_loc=0 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d48.sanity-quota/f48.sanity-quota] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1007 s, 10.4 MB/s checking 60000 exists on mds1 and ost1 checking 60000 removed on mds1 and ost1 pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 checking 60000 recreated on mds1 and ost1 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d48.sanity-quota/f48.sanity-quota] [count=2] 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.355653 s, 5.9 MB/s running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d48.sanity-quota/f48.sanity-quota] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.132437 s, 7.9 MB/s checking 60000 exists on mds1 and ost2 checking 60000 removed on mds1 and ost2 pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 checking 60000 recreated on mds1 and ost2 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d48.sanity-quota/f48.sanity-quota] [count=2] 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.249169 s, 8.4 MB/s /home/green/git/lustre-release/lustre/utils/lfs project -sp 10000 /mnt/lustre/d48.sanity-quota/f48.sanity-quota running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/urandom] [bs=1M] [of=/mnt/lustre/d48.sanity-quota/f48.sanity-quota] [count=1] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12622 s, 8.3 MB/s checking 10000 exists on mds1 and ost1 checking 10000 removed on mds1 and ost1 pdsh@oleg356-client: oleg356-server: ssh exited with exit code 1 Waiting 90s for '' Waiting 80s for '' Waiting 70s for '' Waiting 50s for '' Waiting 40s for '' Waiting 30s for '' Waiting 10s for '' Update not seen after 90s: want '' got '- id: 10000' qmt.lustre-QMT0000.dt-0x0.glb-prj= global_pool0_dt_prj - id: 41000 limits: { hard: 102400, soft: 0, granted: 0, time: 0 } - id: 1 limits: { hard: 0, soft: 0, granted: 0, time: 281474976710656 } - id: 1001 limits: { hard: 81920, soft: 0, granted: 0, time: 0 } - id: 2147483647 limits: { hard: 0, soft: 0, granted: 0, time: 281474976710656 } - id: 0 limits: { hard: 0, soft: 0, granted: 0, time: 604800 } - id: 1000 limits: { hard: 0, soft: 0, granted: 0, time: 0 } - id: 2 limits: { hard: 0, soft: 0, granted: 0, time: 281474976710656 } Disk prj quotas Filesystem quota_id kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 1 0 0 0 - 0 0 0 - /mnt/lustre 2 0 0 0 - 0 0 0 - /mnt/lustre 1000 0 0 0 - 0 0 0 - /mnt/lustre 1001 0 0 81920 - 0 0 4096 - /mnt/lustre 41000 0 0 102400 - 0 0 4096 - /mnt/lustre 2147483647 0 0 0 - 0 0 0 - sanity-quota test_48: @@@@@@ FAIL: QSD: ost1 qid 10000 is not deleted Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7496:error() = /home/green/git/lustre-release/lustre/tests/sanity-quota.sh:4410:test_delete_qid() = /home/green/git/lustre-release/lustre/tests/sanity-quota.sh:4439:test_48() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7873:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7936:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7750:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-quota.sh:4443:main() Dumping lctl log to /tmp/testlogs//sanity-quota.test_48.*.1788314272.log Delete files... Wait for unlink objects finished... rsync: chown "/tmp/testlogs/.sanity-quota.test_48.debug_log.oleg356-server.1788314272.log.EgKdvF" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-quota.test_48.dmesg.oleg356-server.1788314272.log.Gu7vZH" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete