== sanity-quota test 3c: Quota pools: check block soft limit on different pools ========================================================== 03:27:08 (1724311628) limit 4 limit2 8 glbl_limit 12 grace1 30 grace2 20 glbl_grace 40 User quota in qpool2(soft:8 MB grace:20 seconds) Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Creating new pool oleg315-server: Pool lustre.qpool1 created Adding targets to pool oleg315-server: OST lustre-OST0000_UUID added to pool lustre.qpool1 oleg315-server: OST lustre-OST0001_UUID added to pool lustre.qpool1 Creating new pool oleg315-server: Pool lustre.qpool2 created Adding targets to pool oleg315-server: OST lustre-OST0000_UUID added to pool lustre.qpool2 oleg315-server: OST lustre-OST0001_UUID added to pool lustre.qpool2 Waiting for MDT destroys to complete oleg315-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 oleg315-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Write up to soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [count=8] 8+0 records in 8+0 records out 8388608 bytes (8.4 MB) copied, 0.397865 s, 21.1 MB/s Write to exceed soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [bs=1K] [count=10] [seek=8192] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.107525 s, 95.2 kB/s mmap write when over soft limit running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [multiop] [/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0.mmap] [OT40960SMW] Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8248 12288 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8204 - 8216 - - - - - lustre-OST0001 44 - 52 - - - - - Total allocated inode limit: 0, total allocated block limit: 8268 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8248 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8204 - 0 - - - - - lustre-OST0001 44 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write before timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [bs=1K] [count=10] [seek=9216] 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.117895 s, 86.9 kB/s Quota info for qpool2: Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8260* 8192 0 18s 2 0 0 - Grace time is 18s Sleep through grace ... ...sleep 23 seconds Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8260 12288 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 8228 - - - - - lustre-OST0001 44 - 52 - - - - - Total allocated inode limit: 0, total allocated block limit: 8280 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8260 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8216 - 0 - - - - - lustre-OST0001 44 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write after timer goes off running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [bs=1K] [count=4096] [seek=10240] dd: error writing '/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0': Disk quota exceeded 2+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0229054 s, 44.7 kB/s Write after cancel lru locks running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [bs=1K] [count=10] [seek=14336] dd: error writing '/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0': Disk quota exceeded 1+0 records in 0+0 records out 0 bytes (0 B) copied, 0.00575021 s, 0.0 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8264 12288 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8220 - 8228 - - - - - lustre-OST0001 44 - 52 - - - - - Total allocated inode limit: 0, total allocated block limit: 8280 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 8264 0 0 - 2 0 0 - lustre-MDT0000 0 - 0 - 2 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 8220 - 0 - - - - - lustre-OST0001 44 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Unlink file to stop timer Waiting for MDT destroys to complete oleg315-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 oleg315-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 44 12288 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 44 - 52 - - - - - Total allocated inode limit: 0, total allocated block limit: 52 Disk quotas for grp quota_usr (gid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 44 0 0 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 44 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for prj 1000 (pid 1000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Block grace time: 40s; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Block grace time: 1w; Inode grace time: 1w Write ... running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d3c.sanity-quota/f3c.sanity-quota-0] [count=8] 8+0 records in 8+0 records out 8388608 bytes (8.4 MB) copied, 0.320366 s, 26.2 MB/s Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg315-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg315-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg315-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 oleg315-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg315-client: oleg315-server: ssh exited with exit code 1 Destroy the created pools: qpool1,qpool2 lustre.qpool1 oleg315-server: OST lustre-OST0000_UUID removed from pool lustre.qpool1 oleg315-server: OST lustre-OST0001_UUID removed from pool lustre.qpool1 oleg315-server: Pool lustre.qpool1 destroyed lustre.qpool2 oleg315-server: OST lustre-OST0000_UUID removed from pool lustre.qpool2 oleg315-server: OST lustre-OST0001_UUID removed from pool lustre.qpool2 oleg315-server: Pool lustre.qpool2 destroyed