== sanity-quota test 3b: Quota pools: Block soft limit (start timer, expires, stop timer) ========================================================== 06:57:11 (1739534231) limit 4 glbl_limit 8 grace 20 glbl_grace 40 old_mdmb 467 mdmb 1 osc.lustre-OST0000-osc-ffff88012a702000.max_dirty_mb=1 osc.lustre-OST0001-osc-ffff88012a702000.max_dirty_mb=1 User quota in qpool1(soft limit:4 MB grace:20 seconds) -u quota_usr space:0 Creating new pool qpool1 oleg116-server: Pool lustre.qpool1 created Adding targets to pool oleg116-server: OST lustre-OST0000_UUID added to pool lustre.qpool1 oleg116-server: OST lustre-OST0001_UUID added to pool lustre.qpool1 Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.10818 s, 38.8 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0163644 s, 626 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 4176 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 4176 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00651458 s, 1.6 MB/s Quota info for qpool1: Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160* 4096 0 20s 2* 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 4176 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 4176 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.635196 s, 6.6 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00676276 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256* 8192 0 40s 2* 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256* - 8256 - 2* - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 8256 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 1064 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 1064 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.118679 s, 35.3 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Group quota in qpool1(soft limit:4 MB grace:20 seconds) -g quota_usr space:0 Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.114534 s, 36.6 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.009052 s, 1.1 MB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 0 - 1 - 0 - lustre-OST0001 40 - 0 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4176 - 1 - 0 - lustre-OST0001 40 - 48 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 4224 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00395431 s, 2.6 MB/s Quota info for qpool1: Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160* 4096 0 20s 2* 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 0 - 1 - 0 - lustre-OST0001 40 - 0 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4176 - 1 - 0 - lustre-OST0001 40 - 48 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 4224 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.607453 s, 6.9 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00347253 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - 1 - 0 - lustre-OST0001 40 - 0 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256* 8192 0 40s 2* 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - 1* - 0 - lustre-OST0001 40 - 48 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 8264 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 40 - 0 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 40 - 48 - 1 - 0 - Total allocated inode limit: 0, total allocated block limit: 48 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.114889 s, 36.5 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Project quota in qpool1(soft:4 MB grace:20 sec) -p 1000 space:0 Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.124001 s, 33.8 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0100894 s, 1.0 MB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4108 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4176 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 4176 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00397845 s, 2.6 MB/s Quota info for qpool1: Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4120* 4096 0 20s 1* 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 4120 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4176 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 4176 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.638798 s, 6.6 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00472295 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256 - 0 - 2 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 8216* 8192 0 40s 1* 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - 1* - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 8216 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - 1 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes bquota blimit bgrace files iquota ilimit igrace /mnt/lustre 0 8192 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - 0 - 0 - lustre-OST0001 0 - 0 - 0 - 0 - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2 Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.114317 s, 36.7 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg116-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg116-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 pdsh@oleg116-client: oleg116-server: ssh exited with exit code 1 Destroy the created pools: qpool1 lustre.qpool1 oleg116-server: OST lustre-OST0000_UUID removed from pool lustre.qpool1 oleg116-server: OST lustre-OST0001_UUID removed from pool lustre.qpool1 oleg116-server: Pool lustre.qpool1 destroyed osc.lustre-OST0000-osc-ffff88012a702000.max_dirty_mb=467 osc.lustre-OST0001-osc-ffff88012a702000.max_dirty_mb=467