== sanity-quota test 3b: Quota pools: Block soft limit (start timer, expires, stop timer) ========================================================== 13:38:06 (1733164686) limit 4 glbl_limit 8 grace 20 glbl_grace 40 User quota in qpool1(soft limit:4 MB grace:20 seconds) Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Creating new pool oleg128-server: Pool lustre.qpool1 created Waiting 90s for '' Adding targets to pool oleg128-server: OST lustre-OST0000_UUID added to pool lustre.qpool1 oleg128-server: OST lustre-OST0001_UUID added to pool lustre.qpool1 Waiting 90s for 'lustre-OST0000_UUID lustre-OST0001_UUID ' Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.105101 s, 39.9 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00942773 s, 1.1 MB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 4160 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4160 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.003545 s, 2.9 MB/s Quota info for qpool1: Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160* 4096 0 20s 2 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 4168 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4168 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=4096] [seek=6144] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00635301 s, 0.0 kB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00598722 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 4168 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4168 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 1064 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 1064 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.13949 s, 30.1 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Group quota in qpool1(soft limit:4 MB grace:20 seconds) Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.130873 s, 32.0 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0130945 s, 782 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4176 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 4224 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00477935 s, 2.1 MB/s Quota info for qpool1: Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160* 4096 0 20s 2 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 8192 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4176 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 4224 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.666226 s, 6.3 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00412857 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256* 8192 0 39s 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 8264 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 48 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.12118 s, 34.6 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Project quota in qpool1(soft:4 MB grace:20 sec) Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.140992 s, 29.7 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.010515 s, 974 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [multiop] [/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4108 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4176 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4176 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00421048 s, 2.4 MB/s Quota info for qpool1: Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4120* 4096 0 20s 1 0 0 - Grace time is 20s Sleep through grace ... ...sleep 25 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4120 8192 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4176 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4176 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.67373 s, 6.2 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00408233 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8256 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8216* 8192 0 39s 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 8216 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 8192 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w Block grace time: 40s; Inode grace time: 1w /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2 Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3b.sanity-quota/f3b.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.129232 s, 32.5 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Destroy the created pools: qpool1 lustre.qpool1 oleg128-server: OST lustre-OST0000_UUID removed from pool lustre.qpool1 oleg128-server: OST lustre-OST0001_UUID removed from pool lustre.qpool1 oleg128-server: Pool lustre.qpool1 destroyed