== sanity-sec test 64i: Nodemap quota enforcement with local_admin RBAC and offsets ========================================================== 11:46:18 (1788623178) mdt.lustre-MDT0000.identity_upcall=NONE oleg314-server: error: nodemap 'c0' does not exist oleg314-server: nodemap_del: Invalid argument pdsh@oleg314-client: oleg314-server: ssh exited with exit code 1 On MGS 192.168.203.114, active = nodemap.active=1 osd-zfs.lustre-MDT0000.quota_slave_dt.enabled=u Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 5 11:46 . drwxr-xr-x 4 root root 0 Sep 5 11:31 .. drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:05 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:09 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:19 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:26 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:28 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:35 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:36 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:38 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:39 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:40 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:41 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:43 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:44 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 5 11:44 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 5 11:45 d64h.sanity-sec drwxr-xr-x 2 100000 root 16384 Sep 5 11:46 d64i.sanity-sec On MGS 192.168.203.114, c0.offset = nodemap.c0.offset= { start_uid: 100000, limit_uid: 100000, start_gid: 100000, limit_gid: 100000, start_projid: 100000, limit_projid: 100000 } Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 5 11:46 . drwxr-xr-x 4 root root 0 Sep 5 11:31 .. drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:05 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:09 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:19 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:26 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:28 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:35 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:36 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:38 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:39 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:40 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:41 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:43 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:44 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 5 11:44 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 5 11:45 d64h.sanity-sec drwxr-xr-x 2 100000 root 16384 Sep 5 11:46 d64i.sanity-sec Test 1: admin_nodemap=1, local_admin in RBAC, trusted=1 Expected: root can bypass quota (write succeeds) On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.4867 s, 10.6 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 2: admin_nodemap=1, local_admin NOT in RBAC, trusted=1 Expected: root must respect quota (write fails with EDQUOT) On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 10+0 records in 9+0 records out 9437184 bytes (9.4 MB, 9.0 MiB) copied, 0.940706 s, 10.0 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 3: admin_nodemap=1, local_admin NOT in RBAC, trusted=0 Expected: root must respect quota (write fails with EDQUOT) On MGS 192.168.203.114, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 dd output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 10+0 records in 9+0 records out 9437184 bytes (9.4 MB, 9.0 MiB) copied, 1.55661 s, 6.1 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 4: admin_nodemap=1, local_admin in RBAC, trusted=0 Expected: root can bypass quota (write succeeds) On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.34064 s, 11.7 MB/s sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete Test 5: admin_nodemap=0, local_admin in RBAC Expected: root is squashed, permission denied On MGS 192.168.203.114, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 Current MOUNT: total 128 drwxr-xr-x 19 root root 16384 Sep 5 11:46 . drwxr-xr-x 4 root root 0 Sep 5 11:31 .. drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:05 d17.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:09 d18.sanity-sec drwxrwxrwx 2 quota_usr root 16384 Sep 5 11:19 d21.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:26 d25c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:28 d35.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:35 d51.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:36 d55.sanity-sec drwxr-xr-x 3 root root 16384 Sep 5 11:38 d60.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:39 d61.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:40 d64a.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:41 d64c.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:43 d64d.sanity-sec drwxr-xr-x 2 root root 16384 Sep 5 11:44 d64e.sanity-sec drwxrwx---+ 2 root 5000 16384 Sep 5 11:44 d64g.sanity-sec drwxrwxrwx 2 root root 16384 Sep 5 11:45 d64h.sanity-sec drwxr-xr-x 2 nobody nobody 16384 Sep 5 11:48 d64i.sanity-sec dd output: dd: failed to open '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Permission denied sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 6: admin_nodemap=0, local_admin NOT in RBAC Expected: root is squashed, permission denied On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd output: dd: failed to open '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Permission denied On MGS 192.168.203.114, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 7: admin=1, trusted=1, local_admin in RBAC (DOM only) Expected: root can bypass quota (DOM write succeeds) On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall,local_admin 15+0 records in 15+0 records out 15728640 bytes (16 MB, 15 MiB) copied, 1.88191 s, 8.4 MB/s sleep 5 for ZFS MDS Waiting for MDT destroys to complete Test 8: admin=1, trusted=1, local_admin NOT in RBAC (DOM only) Expected: root must respect quota (DOM write fails EDQUOT) On MGS 192.168.203.114, c0.rbac = nodemap.c0.rbac=file_perms,quota_ops,server_upcall dd DOM output: dd: error writing '/mnt/lustre/d64i.sanity-sec/f64i.sanity-sec': Disk quota exceeded 11+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 1.3181 s, 8.0 MB/s osd-zfs.lustre-MDT0000.quota_slave_dt.enabled=none 192.168.203.114@tcp:/lustre /mnt/lustre lustre rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg314-client.virtnet /mnt/lustre (opts:) On MGS 192.168.203.114, active = nodemap.active=0 Starting client: oleg314-client.virtnet: -o user_xattr,flock 192.168.203.114@tcp:/lustre /mnt/lustre