== sanity-quota test 3a: Block soft limit (start timer, timer goes off, stop timer) ========================================================== 05:28:58 (1734431338) User quota (soft limit:4 MB grace:20 seconds) Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.139036 s, 30.2 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0125404 s, 817 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148* 4096 0 18s 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4144 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 4192 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00526228 s, 1.9 MB/s Grace time is 18s Sleep through grace ... ...sleep 23 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160* 4096 0 expired 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4144 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 4192 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 0.951956 s, 4.4 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0117397 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256* 4096 0 expired 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 8264 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 4096 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 48 - - - - - Total allocated inode limit: 0, total allocated block limit: 48 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-0] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.182069 s, 23.0 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Group quota (soft limit:4 MB grace:20 seconds) Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.139789 s, 30.0 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0185561 s, 552 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148* 4096 0 19s 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4148 - 4160 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4160 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00838104 s, 1.2 MB/s Grace time is 19s Sleep through grace ... ...sleep 24 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160* 4096 0 expired 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 4168 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4168 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [bs=1K] [count=4096] [seek=6144] dd: error writing '/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0101548 s, 0.0 kB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.028235 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160* 4096 0 expired 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4160 - 4168 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4168 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 4096 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 40 - 1064 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 1064 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-1] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.198448 s, 21.1 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Project quota (soft limit:4 MB grace:20 sec) Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.146381 s, 28.7 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [bs=1K] [count=10] [seek=4096] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0128884 s, 795 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [multiop] [/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4148 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4108* 4096 0 19s 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4108 - 4144 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4144 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [bs=1K] [count=10] [seek=5120] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00728565 s, 1.4 MB/s Grace time is 19s Sleep through grace ... ...sleep 24 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4160 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 4120* 4096 0 expired 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 4120 - 4144 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 4144 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [bs=1K] [count=4096] [seek=6144] 4096+0 records in 4096+0 records out 4194304 bytes (4.2 MB) copied, 1.03593 s, 4.0 MB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [bs=1K] [count=10] [seek=10240] dd: error writing '/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.0102443 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8256 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8216* 4096 0 expired 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216* - 8216 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 8216 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 40 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 40 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 4096 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w Block grace time: 20s; Inode grace time: 1w /home/green/git/lustre-release/lustre/utils/lfs project -p 1000 /mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2 Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: 60000 [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3a.sanity-quota/f3a.sanity-quota-2] [count=4] 4+0 records in 4+0 records out 4194304 bytes (4.2 MB) copied, 0.174128 s, 24.1 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg359-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg359-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1 pdsh@oleg359-client: oleg359-server: ssh exited with exit code 1