== sanity-quota test 17: DQACQ return recoverable error == 13:56:29 (1733165789) DQACQ return -ENOLCK Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Waiting 90s for 'ug' Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 fail_val=37 fail_loc=0xa04 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d17.sanity-quota/f17.sanity-quota] [count=1] [oflag=direct] fail_val=0 fail_loc=0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 2.96321 s, 354 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 1024 0 10240 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 1024 - 2048 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 2048 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 DQACQ return -EAGAIN Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 fail_val=11 fail_loc=0xa04 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d17.sanity-quota/f17.sanity-quota] [count=1] [oflag=direct] fail_val=0 fail_loc=0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.03869 s, 345 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 1024 0 10240 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 1024 - 2048 - - - - - Total allocated inode limit: 0, total allocated block limit: 2048 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 DQACQ return -ETIMEDOUT Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 fail_val=110 fail_loc=0xa04 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d17.sanity-quota/f17.sanity-quota] [count=1] [oflag=direct] fail_val=0 fail_loc=0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.47172 s, 302 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 1024 0 10240 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 1024 - 2048 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 2048 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 DQACQ return -ENOTCONN Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Creating test directory fail_val=0 fail_loc=0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 0 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 0 0 10240 - 0 0 0 - lustre-MDT0000 0 - 0 - 0 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 0 - 0 - - - - - Total allocated inode limit: 0, total allocated block limit: 0 fail_val=107 fail_loc=0xa04 running as uid/gid/euid/egid 60000/60000/60000/60000, groups: [dd] [if=/dev/zero] [bs=1M] [of=/mnt/lustre/d17.sanity-quota/f17.sanity-quota] [count=1] [oflag=direct] fail_val=0 fail_loc=0 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.04623 s, 344 kB/s Disk quotas for usr quota_usr (uid 60000): Filesystem kbytes quota limit grace files quota limit grace /mnt/lustre 1024 0 10240 - 1 0 0 - lustre-MDT0000 0 - 0 - 1 - 0 - lustre-MDT0001 0 - 0 - 0 - 0 - lustre-OST0000 0 - 0 - - - - - lustre-OST0001 1024 - 2048 - - - - - Total allocated inode limit: 0, total allocated block limit: 2048 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 Delete files... Wait for unlink objects finished... Waiting for MDT destroys to complete oleg128-server: fstrim: /mnt/lustre-ost1: the discard operation is not supported oleg128-server: fstrim: /mnt/lustre-ost2: the discard operation is not supported pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1 pdsh@oleg128-client: oleg128-server: ssh exited with exit code 1