== sanity-sec test 64i: Nodemap quota enforcement with local_admin RBAC and offsets ========================================================== 08:36:14 (1788525374) mdt.lustre-MDT0000.identity_upcall=NONE oleg338-server: error: nodemap 'c0' does not exist oleg338-server: nodemap_del: Invalid argument pdsh@oleg338-client: oleg338-server: ssh exited with exit code 1 On MGS 192.168.203.138, active = nodemap.active=1 osd-zfs.lustre-MDT0000.quota_slave_dt.enabled=u Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 4 08:36 . drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:55 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:59 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 08:09 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:15 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:17 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:25 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:25 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:27 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:28 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:32 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:33 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 4 08:34 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 4 08:35 d64h.sanity-sec drwxr-xr-x 2 100000 root 16384 Sep 4 08:36 d64i.sanity-sec On MGS 192.168.203.138, c0.offset = nodemap.c0.offset= { start_uid: 100000, limit_uid: 100000, start_gid: 100000, limit_gid: 100000, start_projid: 100000, limit_projid: 100000 } Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 4 08:36 . drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:55 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:59 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 08:09 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:15 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:17 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:25 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:25 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:27 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:28 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:32 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:33 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 4 08:34 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 4 08:35 d64h.sanity-sec drwxr-xr-x 2 100000 root 16384 Sep 4 08:36 d64i.sanity-sec Test 1: admin_nodemap=1, local_admin in RBAC, trusted=1 Expected: root can bypass quota (write succeeds) On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.52686 s, 10.3 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 2: admin_nodemap=1, local_admin NOT in RBAC, trusted=1 Expected: root must respect quota (write fails with EDQUOT) On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 10+0 records in 9+0 records out 9437184 bytes (9.4 MB, 9.0 MiB) copied, 1.37251 s, 6.9 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 3: admin_nodemap=1, local_admin NOT in RBAC, trusted=0 Expected: root must respect quota (write fails with EDQUOT) On MGS 192.168.203.138, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 dd output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 10+0 records in 9+0 records out 9437184 bytes (9.4 MB, 9.0 MiB) copied, 1.62382 s, 5.8 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 4: admin_nodemap=1, local_admin in RBAC, trusted=0 Expected: root can bypass quota (write succeeds) On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.31193 s, 12.0 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 5: admin_nodemap=0, local_admin in RBAC Expected: root is squashed, permission denied On MGS 192.168.203.138, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 4 08:36 . drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:55 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 07:59 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 4 08:09 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:15 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:17 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:25 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:25 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 4 08:27 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:28 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:30 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:32 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 4 08:33 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 4 08:34 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 4 08:35 d64h.sanity-sec drwxr-xr-x 2 nobody nobody 16384 Sep 4 08:38 d64i.sanity-sec dd output: dd: failed to open '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Permission denied sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 6: admin_nodemap=0, local_admin NOT in RBAC Expected: root is squashed, permission denied On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd output: dd: failed to open '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Permission denied On MGS 192.168.203.138, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 7: admin=1, trusted=1, local_admin in RBAC (DOM only) Expected: root can bypass quota (DOM write succeeds) On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.96715 s, 8.0 MB/s sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 8: admin=1, trusted=1, local_admin NOT in RBAC (DOM only) Expected: root must respect quota (DOM write fails EDQUOT) On MGS 192.168.203.138, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd DOM output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 11+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 2.03394 s, 5.2 MB/s osd-zfs.lustre-MDT0000.quota_slave_dt.enabled=none 192.168.203.138@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg338-client.virtnet /mnt/lustre (opts:) On MGS 192.168.203.138, active = nodemap.active=0 Starting client: oleg338-client.virtnet: -o user_xattr,flock 192.168.203.138@tcp:/lustre /mnt/lustre