-----============= acceptance-small: sanity-sec ============----- Fri Oct 24 09:13:03 EDT 2025 oleg418-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-sec.*ex': No such file or directory excepting tests: 27 skipping tests SLOW=no: 26 was USER0=sanityusr:x:500:500::/home/lustreuser:/bin/bash was USER1=sanityusr1:x:501:501::/home/sanityusr1:/bin/bash now USER0=sanityusr=500:500, USER1=sanityusr1=501:501 oleg418-client.virtnet: executing check_config_client /mnt/lustre oleg418-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg418-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8a03c5529800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8a03c5529800.idle_timeout=debug disable quota as required oleg418-server: oleg418-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 without GSS support == sanity-sec test 0: uid permission ======================================================================================= 09:13:52 (1761311632) running as uid/gid/euid/egid 500/500/500/500, groups: [ls] [/mnt/lustre] d0.sanity-sec running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/f0] touch: cannot touch '/mnt/lustre/f0': Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0.sanity-sec/f1] running as uid/gid/euid/egid 501/501/501/501, groups: [touch] [/mnt/lustre/d0.sanity-sec/f2] touch: cannot touch '/mnt/lustre/d0.sanity-sec/f2': Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0.sanity-sec/f4] running as uid/gid/euid/egid 501/501/501/501, groups: [touch] [/mnt/lustre/d0.sanity-sec/f5] touch: cannot touch '/mnt/lustre/d0.sanity-sec/f5': Permission denied PASS 0 (8s) == sanity-sec test 1: setuid/gid ======================================================================================= 09:14:00 (1761311640) SKIP: sanity-sec test_1 without GSS support. SKIP 1 (3s) == sanity-sec test 4: set supplementary group ========================================================================= 09:14:03 (1761311643) /home/green/git/lustre-release/lustre/tests/sanity-sec.sh: illegal option -- p running as uid/gid/euid/egid 500/500/500/500, groups: [ls] [/mnt/lustre/d4.sanity-sec] running as uid/gid/euid/egid 501/501/501/501, groups: 1 2 500 [ls] [/mnt/lustre/d4.sanity-sec] running as uid/gid/euid/egid 501/501/501/501, groups: 1 2 [ls] [/mnt/lustre/d4.sanity-sec] ls: cannot open directory '/mnt/lustre/d4.sanity-sec': Permission denied PASS 4 (10s) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_projid = nodemap.default.squash_projid=99 waiting 10 secs for sync == sanity-sec test 7: nodemap create and delete ========== 09:14:56 (1761311696) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=1 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=2 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=3 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 7 (128s) == sanity-sec test 8: nodemap reject duplicates ========== 09:17:04 (1761311824) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=4 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=5 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=6 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync oleg418-server: error: 51428_0 existing nodemap name pdsh@oleg418-client: oleg418-server: ssh exited with exit code 1 nodemap_add 51428_0 failed with 1 On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 8 (158s) == sanity-sec test 9: nodemap range add ================== 09:19:42 (1761311982) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=7 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=8 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=9 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 9 (133s) == sanity-sec test 10a: nodemap reject duplicate ranges == 09:21:55 (1761312115) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=10 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=11 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=12 waiting 10 secs for sync oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.0.0.[1-253]@tcp' to nodemap '51428_0': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.0.1.[1-253]@tcp' to nodemap '51428_0': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.1.0.[1-253]@tcp' to nodemap '51428_1': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.1.1.[1-253]@tcp' to nodemap '51428_1': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.2.0.[1-253]@tcp' to nodemap '51428_2': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 oleg418-server: error: invalid ioctl: 000ce042 errno: 17: File exists oleg418-server: error: nodemap_add_range: cannot add range '179.2.1.[1-253]@tcp' to nodemap '51428_2': File exists pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 10a (138s) == sanity-sec test 10b: delete range from the correct nodemap ========================================================== 09:24:13 (1761312253) oleg418-server: error: invalid ioctl: 000ce043 errno: 22: Invalid argument oleg418-server: error: nodemap_del_range: cannot delete range '192.168.19.[0-255]@o2ib20' to nodemap 'nodemap2': rc = -22 pdsh@oleg418-client: oleg418-server: ssh exited with exit code 22 PASS 10b (15s) == sanity-sec test 10c: verfify contiguous range support ========================================================== 09:24:28 (1761312268) PASS 10c (10s) == sanity-sec test 10d: verfify nodemap range format '*@' support ========================================================== 09:24:38 (1761312278) PASS 10d (11s) == sanity-sec test 11: nodemap modify ==================== 09:24:49 (1761312289) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=17 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=18 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=19 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 11 (131s) == sanity-sec test 12: nodemap set squash ids ============ 09:27:00 (1761312420) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=20 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=21 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=22 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 12 (127s) == sanity-sec test 13: test nids ========================= 09:29:07 (1761312547) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=23 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=24 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=25 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 13 (135s) == sanity-sec test 14: test default nodemap nid lookup === 09:31:22 (1761312682) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=26 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=27 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=28 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync PASS 14 (123s) == sanity-sec test 15: test id mapping =================== 09:33:25 (1761312805) On MGS 192.168.204.118, default.squash_uid = nodemap.default.squash_uid=99 waiting 10 secs for sync On MGS 192.168.204.118, default.squash_gid = nodemap.default.squash_gid=99 waiting 10 secs for sync On MGS 192.168.204.118, 51428_0.id = nodemap.51428_0.id=29 waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = nodemap.51428_1.id=30 waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = nodemap.51428_2.id=31 waiting 10 secs for sync Start to add idmaps ... Start to test idmaps ... Start to update idmaps ... Start to delete idmaps ... On MGS 192.168.204.118, 51428_0.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_1.id = waiting 10 secs for sync On MGS 192.168.204.118, 51428_2.id = waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 15 (204s) == sanity-sec test 16: test nodemap all_off fileops ====== 09:36:49 (1761313009) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync mkdir -p /mnt/lustre/d16.sanity-sec ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d16.sanity-sec/f16.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d16.sanity-sec/f16.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] mkdir -p /mnt/lustre/d16.sanity-sec ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d16.sanity-sec/f16.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d16.sanity-sec/f16.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 16 (234s) == sanity-sec test 17: test nodemap trusted_noadmin fileops ========================================================== 09:40:43 (1761313243) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync mkdir -p /mnt/lustre/d17.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d17.sanity-sec/f17.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d17.sanity-sec/f17.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d17.sanity-sec': Permission denied mkdir -p /mnt/lustre/d17.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d17.sanity-sec/f17.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d17.sanity-sec/f17.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d17.sanity-sec': Permission denied On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 17 (656s) == sanity-sec test 18: test nodemap mapped_noadmin fileops ========================================================== 09:51:39 (1761313899) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync mkdir -p /mnt/lustre/d18.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d18.sanity-sec/f18.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d18.sanity-sec/f18.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d18.sanity-sec': Permission denied mkdir -p /mnt/lustre/d18.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d18.sanity-sec/f18.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d18.sanity-sec/f18.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d18.sanity-sec': Permission denied On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 18 (652s) == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 10:02:32 (1761314552) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync mkdir -p /mnt/lustre/d19.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d19.sanity-sec/f19.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d19.sanity-sec/f19.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] mkdir -p /mnt/lustre/d19.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d19.sanity-sec/f19.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d19.sanity-sec/f19.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 19 (336s) == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 10:08:08 (1761314888) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync mkdir -p /mnt/lustre/d20.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d20.sanity-sec/f20.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d20.sanity-sec/f20.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] mkdir -p /mnt/lustre/d20.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d20.sanity-sec/f20.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d20.sanity-sec/f20.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 20 (339s) == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 10:13:47 (1761315227) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync mkdir -p /mnt/lustre/d21.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d21.sanity-sec/f21.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d21.sanity-sec/f21.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d21.sanity-sec': Permission denied mkdir -p /mnt/lustre/d21.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d21.sanity-sec/f21.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d21.sanity-sec/f21.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] rm: cannot remove '/mnt/lustre/d21.sanity-sec': Permission denied On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 21 (681s) == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 10:25:08 (1761315908) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync mkdir -p /mnt/lustre/d22.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d22.sanity-sec/f22.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d22.sanity-sec/f22.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] mkdir -p /mnt/lustre/d22.sanity-sec On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync ldlm.namespaces.lustre-MDT0000-mdc-ffff8a03c5529800.lru_size=clear On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 0/0/0/0, groups: 0 [rm] [/mnt/lustre/d22.sanity-sec/f22.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 0/0/0/0, groups: 0 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [rm] [/mnt/lustre/d22.sanity-sec/f22.sanity-sec] sleep 5 for ZFS MDS sleep 5 for ZFS OST running as uid/gid/euid/egid 60003/60003/60003/60003, groups: 60003 [lfs] [quota] [-q] [/mnt/lustre] On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 22 (331s) == sanity-sec test 23a: test mapped regular ACLs ========= 10:30:39 (1761316239) SKIP: sanity-sec test_23a Need 2 clients at least SKIP 23a (3s) == sanity-sec test 23b: test mapped default ACLs ========= 10:30:42 (1761316242) SKIP: sanity-sec test_23b Need 2 clients at least SKIP 23b (3s) == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 10:30:46 (1761316246) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync nodemap.active=1 nodemap.c0.admin_nodemap=0 nodemap.c0.audit_mode=1 nodemap.c0.deny_unknown=0 nodemap.c0.exports= [ { nid: 192.168.204.18@tcp, uuid: faadea81-0bb5-498d-b889-79f26164b543 }, ] nodemap.c0.fileset= nodemap.c0.forbid_encryption=0 nodemap.c0.id=39 nodemap.c0.idmap= [ { idtype: uid, client_id: 60003, fs_id: 60000 }, { idtype: uid, client_id: 60004, fs_id: 60002 }, { idtype: gid, client_id: 60003, fs_id: 60000 }, { idtype: gid, client_id: 60004, fs_id: 60002 } ] nodemap.c0.map_mode=all nodemap.c0.ranges= [ { id: 41, start_nid: 192.168.204.18@tcp, end_nid: 192.168.204.18@tcp } ] nodemap.c0.sepol= nodemap.c0.squash_gid=99 nodemap.c0.squash_projid=99 nodemap.c0.squash_uid=99 nodemap.c0.trusted_nodemap=0 nodemap.default.admin_nodemap=1 nodemap.default.audit_mode=1 nodemap.default.deny_unknown=0 nodemap.default.exports= [ { nid: 0@lo, uuid: lustre-MDT0000-mdtlov_UUID }, { nid: 0@lo, uuid: lustre-MDT0000-lwp-OST0001_UUID }, { nid: 0@lo, uuid: lustre-MDT0000-mdtlov_UUID }, { nid: 0@lo, uuid: lustre-MDT0000-lwp-OST0000_UUID }, { nid: 0@lo, uuid: lustre-MDT0000-lwp-MDT0000_UUID }, ] nodemap.default.fileset= nodemap.default.forbid_encryption=0 nodemap.default.id=0 nodemap.default.map_mode=all nodemap.default.squash_gid=99 nodemap.default.squash_projid=99 nodemap.default.squash_uid=99 nodemap.default.trusted_nodemap=1 On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 24 (99s) == sanity-sec test 25: test save and reload nodemap config ========================================================== 10:32:24 (1761316344) Stopping clients: oleg418-client.virtnet /mnt/lustre (opts:) Stopping client oleg418-client.virtnet /mnt/lustre opts: mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, test25.id = nodemap.test25.id=41 waiting 10 secs for sync Checking servers environments Checking clients oleg418-client.virtnet environments /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions loading modules on: 'oleg418-server' oleg418-server: oleg418-server.virtnet: executing load_modules_local oleg418-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg418-server: Loading modules from /home/green/git/lustre-release/lustre oleg418-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg418-server: detected 4 online CPUs by sysfs oleg418-server: Force libcfs to create 2 CPU partitions Setup mgs, mdt, osts Starting mds1: -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1 oleg418-server: mount.lustre: according to /etc/mtab lustre-mdt1/mdt1 is already mounted on /mnt/lustre-mds1 pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 Start of lustre-mdt1/mdt1 on mds1 failed 17 Starting ost1: -o localrecov lustre-ost1/ost1 /mnt/lustre-ost1 oleg418-server: mount.lustre: according to /etc/mtab lustre-ost1/ost1 is already mounted on /mnt/lustre-ost1 pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 Start of lustre-ost1/ost1 on ost1 failed 17 Starting ost2: -o localrecov lustre-ost2/ost2 /mnt/lustre-ost2 oleg418-server: mount.lustre: according to /etc/mtab lustre-ost2/ost2 is already mounted on /mnt/lustre-ost2 pdsh@oleg418-client: oleg418-server: ssh exited with exit code 17 Start of lustre-ost2/ost2 on ost2 failed 17 Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre Starting client oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre Started clients oleg418-client.virtnet: 192.168.204.118@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8a03c4f1d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8a03c4f1d800.idle_timeout=debug disable quota as required Stopping clients: oleg418-client.virtnet /mnt/lustre (opts:) Stopping client oleg418-client.virtnet /mnt/lustre opts: On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync Starting client oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre Started clients oleg418-client.virtnet: 192.168.204.118@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) PASS 25 (166s) SKIP: sanity-sec test_26 skipping SLOW test 26 SKIP: sanity-sec test_27a skipping excluded test 27a (base 27) SKIP: sanity-sec test_27b skipping excluded test 27b (base 27) == sanity-sec test 28: check shared key rotation method == 10:35:14 (1761316514) SKIP: sanity-sec test_28 need shared key feature for this test SKIP 28 (4s) == sanity-sec test 29: check for missing shared key ====== 10:35:18 (1761316518) SKIP: sanity-sec test_29 need shared key feature for this test SKIP 29 (3s) == sanity-sec test 30: check for invalid shared key ====== 10:35:21 (1761316521) SKIP: sanity-sec test_30 need shared key feature for this test SKIP 30 (3s) == sanity-sec test 30b: basic test of all different SSK flavors ========================================================== 10:35:24 (1761316524) SKIP: sanity-sec test_30b need shared key feature for this test SKIP 30b (2s) == sanity-sec test 31: client mount option '-o network' == 10:35:27 (1761316527) SKIP: sanity-sec test_31 without lnetctl support. SKIP 31 (3s) == sanity-sec test 32: check for mgssec ================== 10:35:31 (1761316531) SKIP: sanity-sec test_32 need shared key feature for this test SKIP 32 (3s) == sanity-sec test 33: correct srpc flags for MGS connection ========================================================== 10:35:33 (1761316533) SKIP: sanity-sec test_33 need shared key feature for this test SKIP 33 (3s) == sanity-sec test 34: deny_unknown on default nodemap === 10:35:36 (1761316536) On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.deny_unknown = nodemap.default.deny_unknown=1 waiting 10 secs for sync On MGS 192.168.204.118, default.deny_unknown = nodemap.default.deny_unknown=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync PASS 34 (65s) == sanity-sec test 35: Check permissions when accessing changelogs ========================================================== 10:36:41 (1761316601) mdd.lustre-MDT0000.changelog_mask=+hsm Registered 1 changelog users: 'cl1' mdd.lustre-MDT0000.changelog_mask=ALL lustre-MDT0000.1 02MKDIR 14:36:48.412789736 2025.10.24 0x0 t=[0x200000402:0x1:0x0] j=mkdir.0 ef=0xf u=0:0 nid=192.168.204.18@tcp p=[0x200000007:0x1:0x0] d35.sanity-sec lustre-MDT0000.2 01CREAT 14:36:48.457678687 2025.10.24 0x0 t=[0x200000402:0x2:0x0] j=touch.0 ef=0xf u=0:0 nid=192.168.204.18@tcp p=[0x200000402:0x1:0x0] f35.sanity-sec lustre-MDT0000.3 10OPEN 14:36:48.457984817 2025.10.24 0x4a t=[0x200000402:0x2:0x0] j=touch.0 ef=0xf u=0:0 nid=192.168.204.18@tcp m=-w- p=[0x200000402:0x1:0x0] lustre-MDT0000.4 11CLOSE 14:36:48.564700209 2025.10.24 0x42 t=[0x200000402:0x2:0x0] j=touch.0 ef=0xf u=0:0 nid=192.168.204.18@tcp lustre-MDT0000: clear the changelog for cl1 of all records mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync lfs changelog: cannot access changelog: Permission denied lustre-MDT0000: clear the changelog for cl1 of all records lfs changelog_clear: cannot purge records for 'cl1': Permission denied (13) changelog_clear error: Permission denied On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync lustre-MDT0000: clear the changelog for cl1 of all records lustre-MDT0000: Deregistered changelog user #1 PASS 35 (116s) == sanity-sec test 36: control if clients can use encryption ========================================================== 10:38:37 (1761316717) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) On MGS 192.168.204.118, default.forbid_encryption = nodemap.default.forbid_encryption=1 waiting 10 secs for sync Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre mount.lustre: mount oleg418-server@tcp:/lustre at /mnt/lustre failed: Permission denied On MGS 192.168.204.118, default.forbid_encryption = nodemap.default.forbid_encryption=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 36 (71s) == sanity-sec test 37: simple encrypted file ============= 10:39:48 (1761316788) SKIP: sanity-sec test_37 ldiskfs only test (using debugfs) SKIP 37 (5s) == sanity-sec test 38: encrypted file with hole ========== 10:39:53 (1761316793) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 4 bytes copied, 0.148768 s, 0.0 kB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 38 (32s) == sanity-sec test 39: rewrite data in already encrypted page ========================================================== 10:40:25 (1761316825) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 4 bytes copied, 0.0508155 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0500673 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.00131081 s, 3.1 kB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 39 (32s) == sanity-sec test 40: exercise size of encrypted file === 10:40:57 (1761316857) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 4 bytes copied, 0.0634685 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.140983 s, 0.0 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000888408 s, 4.5 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0759689 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0444243 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.00110353 s, 3.6 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0792356 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.00026651 s, 15.0 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0549271 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000267442 s, 15.0 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0727154 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0502658 s, 0.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000248473 s, 16.1 kB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre PASS 40 (101s) == sanity-sec test 41: test race on encrypted file size (1) ========================================================== 10:42:38 (1761316958) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 4 bytes copied, 0.000299733 s, 13.3 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000308586 s, 13.0 kB/s fail_loc=0x250 fail_val=15 1+0 records in 1+0 records out 4 bytes copied, 10.1428 s, 0.0 kB/s 1+0 records in 1+0 records out 4 bytes copied, 15.1579 s, 0.0 kB/s fail_loc=0x0 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 41 (51s) == sanity-sec test 42: test race on encrypted file size (2) ========================================================== 10:43:29 (1761317009) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre2 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0692354 s, 59.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000254983 s, 16.1 MB/s 1+0 records in 1+0 records out 4 bytes copied, 0.00120325 s, 3.3 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000247693 s, 16.1 kB/s fail_loc=0x250 fail_val=15 1+0 records in 1+0 records out 4 bytes copied, 10.1844 s, 0.0 kB/s 1+0 records in 1+0 records out 4 bytes copied, 15.2043 s, 0.0 kB/s fail_loc=0x0 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre2 (opts:) 1 keys reaped PASS 42 (52s) == sanity-sec test 43: test race on encrypted file size (3) ========================================================== 10:44:21 (1761317061) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre2 4096+0 records in 4096+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0158733 s, 258 kB/s fail_loc=0x250 fail_val=15 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 10.0559 s, 0.4 kB/s 1+0 records in 1+0 records out 4 bytes copied, 15.105 s, 0.0 kB/s fail_loc=0x0 1+0 records in 1+0 records out 4 bytes copied, 0.000283907 s, 14.1 kB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre2 (opts:) 1 keys reaped PASS 43 (49s) == sanity-sec test 44: encrypted file access semantics: direct IO ========================================================== 10:45:11 (1761317111) /usr/bin/which: no vmtouch in (/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:) SKIP: sanity-sec test_44 This test needs vmtouch utility SKIP 44 (3s) == sanity-sec test 45: encrypted file access semantics: MMAP ========================================================== 10:45:14 (1761317114) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0281387 s, 18.6 MB/s 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.00630642 s, 83.1 MB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 45 (31s) == sanity-sec test 46: encrypted file access semantics without key ========================================================== 10:45:46 (1761317146) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped File: /mnt/lustre/d46.sanity-sec/_LQAAAIAAAAgBAAAAAAAAAghbYZ3D9bRhrq1Br46NK9G Size: 11264 Blocks: 22 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205440274438 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 10:45:50.000000000 -0400 Modify: 2025-10-24 10:45:50.000000000 -0400 Change: 2025-10-24 10:45:50.000000000 -0400 Birth: 2025-10-24 10:45:50.000000000 -0400 File: /mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/_LQAAAIAAAAQBAAAAAAAAAkqgCPFHORqoqOhK18j5jDG Size: 4096 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205440274437 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 10:45:50.000000000 -0400 Modify: 2025-10-24 10:45:50.000000000 -0400 Change: 2025-10-24 10:45:50.000000000 -0400 Birth: 2025-10-24 10:45:50.000000000 -0400 cat: /mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/_LQAAAIAAAAQBAAAAAAAAAkqgCPFHORqoqOhK18j5jDG: Required key not available File: /mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/Y+nqvgwh3Zdh247XiH4KgA Size: 4096 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205440274436 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 10:45:50.000000000 -0400 Modify: 2025-10-24 10:45:50.000000000 -0400 Change: 2025-10-24 10:45:50.000000000 -0400 Birth: 2025-10-24 10:45:50.000000000 -0400 cat: /mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/Y+nqvgwh3Zdh247XiH4KgA: Required key not available touch: cannot touch '/mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/otherfile': Required key not available ls: cannot access '/mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/otherfile': Required key not available mkdir: cannot create directory '/mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/otherdir': Required key not available ls: cannot access '/mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB/otherdir': No such file or directory /mnt/lustre: d17.sanity-sec d18.sanity-sec d21.sanity-sec d35.sanity-sec d46.sanity-sec /mnt/lustre/d17.sanity-sec: /mnt/lustre/d18.sanity-sec: /mnt/lustre/d21.sanity-sec: /mnt/lustre/d35.sanity-sec: f35.sanity-sec /mnt/lustre/d46.sanity-sec: NyswYsWcOYT1jEU9QH2htB WSsNeP6G,YDmllcxXOJmIC /mnt/lustre/d46.sanity-sec/NyswYsWcOYT1jEU9QH2htB: Y+nqvgwh3Zdh247XiH4KgA /mnt/lustre: d17.sanity-sec d18.sanity-sec d21.sanity-sec d35.sanity-sec d46.sanity-sec /mnt/lustre/d17.sanity-sec: /mnt/lustre/d18.sanity-sec: /mnt/lustre/d21.sanity-sec: /mnt/lustre/d35.sanity-sec: f35.sanity-sec /mnt/lustre/d46.sanity-sec: WSsNeP6G,YDmllcxXOJmIC 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre PASS 46 (15s) == sanity-sec test 47: encrypted file access semantics: rename/link ========================================================== 10:46:00 (1761317160) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0328376 s, 16.0 MB/s rename returned -1: Invalid cross-device link ln: failed to create hard link '/mnt/lustre/d47.sanity-sec/f47.sanity-sec' => '/mnt/lustre/junk': Invalid cross-device link rename returned 0: Success ln: failed to create hard link '/mnt/lustre/d47.sanity-sec/f47.sanity-sec_107' => '/mnt/lustre/d47.sanity-sec/f47.sanity-sec.2': Value too large for defined data type rename returned -1: Invalid cross-device link 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0353019 s, 14.9 MB/s 1+0 records in 1+0 records out 524288 bytes (524 kB, 512 KiB) copied, 0.0353665 s, 14.8 MB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped ln: failed to create hard link '/mnt/lustre/d47.sanity-sec/cRjUXWi,eyn15W5fSbc+vA/linkfile' => '/mnt/lustre/d47.sanity-sec/r5wBqaRRKuaSA,bRj70bxA': Required key not available rename returned -1: Required key not available rename returned -1: Required key not available _AAAAAAAAAAgeN0QCrYcOQyi77nIf3qze ln: failed to access '/mnt/lustre/d47.sanity-sec/r5wBqaRRKuaSA,bRj70bxA.sym': Required key not available ln: failed to access '/mnt/lustre/d47.sanity-sec/r5wBqaRRKuaSA,bRj70bxA.sl': Required key not available 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre PASS 47 (21s) == sanity-sec test 48a: encrypted file access semantics: truncate ========================================================== 10:46:22 (1761317182) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 16384+0 records in 16384+0 records out 16384 bytes (16 kB, 16 KiB) copied, 0.037299 s, 439 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.000304917 s, 13.1 kB/s 1+0 records in 1+0 records out 4 bytes copied, 0.0994161 s, 0.0 kB/s 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped truncate: cannot truncate '/mnt/lustre/d48a.sanity-sec/x2ATpx3QSnMaigPn9ADhoD' to length 0: Required key not available 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre PASS 48a (39s) == sanity-sec test 48b: encrypted file: concurrent truncate ========================================================== 10:47:00 (1761317220) SKIP: sanity-sec test_48b Need at least 2 clients SKIP 48b (4s) == sanity-sec test 49: Avoid getxattr for encryption context ========================================================== 10:47:04 (1761317224) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre debug=+info stat /mnt/lustre/d49.sanity-sec/subdir File: /mnt/lustre/d49.sanity-sec/subdir Size: 1024 Blocks: 2 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205507383298 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 10:47:08.000000000 -0400 Modify: 2025-10-24 10:47:08.000000000 -0400 Change: 2025-10-24 10:47:08.000000000 -0400 Birth: 2025-10-24 10:47:09.000000000 -0400 debug=+info stat /mnt/lustre/d49.sanity-sec/subdir/f1 File: /mnt/lustre/d49.sanity-sec/subdir/f1 Size: 21 Blocks: 11 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205507383299 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-10-24 10:47:08.000000000 -0400 Modify: 2025-10-24 10:47:08.000000000 -0400 Change: 2025-10-24 10:47:08.000000000 -0400 Birth: 2025-10-24 10:47:09.000000000 -0400 debug=+info cat /mnt/lustre/d49.sanity-sec/subdir/f1 debug=+info echo a a 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.399423 s, 26.3 MB/s debug=+info /home/green/git/lustre-release/lustre/tests/truncate /mnt/lustre/d49.sanity-sec/subdir/f1 10240 debug=+info /home/green/git/lustre-release/lustre/utils/lfs setstripe -E -1 -S 4M /mnt/lustre/d49.sanity-sec/subdir/f2 debug=+info /home/green/git/lustre-release/lustre/utils/lfs migrate -E -1 -S 256K /mnt/lustre/d49.sanity-sec/subdir/f2 SKIP: sanity-sec test_49 2nd part needs >= 2 MDTs 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped SKIP 49 (17s) == sanity-sec test 50: DoM encrypted file ================ 10:47:21 (1761317241) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 5000+0 records in 5000+0 records out 5000 bytes (5.0 kB, 4.9 KiB) copied, 0.00919471 s, 544 kB/s 1 keys reaped 286710722 1 keys reaped 731062080 1 keys reaped 713193549 1 keys reaped 1046580033 1 keys reaped 890781907 1 keys reaped 942567970 1 keys reaped 116742010 1 keys reaped 981510451 1539+0 records in 1539+0 records out 1539 bytes (1.5 kB, 1.5 KiB) copied, 0.00738141 s, 208 kB/s 1 keys reaped 2289118 1 keys reaped 460119655 1 keys reaped 709299234 1 keys reaped 634174130 1 keys reaped 63786531 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 50 (27s) == sanity-sec test 51: FS capabilities =================== 10:47:48 (1761317268) mdt.lustre-MDT0000.enable_cap_mask=0xf running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/chown] [500] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] /mnt/lustre/d51.sanity-sec/chown: changing ownership of '/mnt/lustre/d51.sanity-sec/f51.sanity-sec': Operation not permitted running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/chown] [500] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/touch] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] /mnt/lustre/d51.sanity-sec/touch: cannot touch '/mnt/lustre/d51.sanity-sec/f51.sanity-sec': Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/touch] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/cat] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] /mnt/lustre/d51.sanity-sec/cat: /mnt/lustre/d51.sanity-sec/f51.sanity-sec: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/cat] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/cat] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] /mnt/lustre/d51.sanity-sec/cat: /mnt/lustre/d51.sanity-sec/f51.sanity-sec: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [/mnt/lustre/d51.sanity-sec/cat] [/mnt/lustre/d51.sanity-sec/f51.sanity-sec] mdt.lustre-MDT0000.enable_cap_mask=0x0 PASS 51 (10s) == sanity-sec test 52: Mirrored encrypted file =========== 10:47:58 (1761317278) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 5000 bytes (5.0 kB, 4.9 KiB) copied, 0.000338646 s, 14.8 MB/s 1+0 records in 1+0 records out 5000 bytes (5.0 kB, 4.9 KiB) copied, 0.056121 s, 89.1 kB/s CRC-32 checksum value for chunk [0, 0xffffffffffffffff): Mirror 1: 0x902fb0d4 Mirror 2: 0x902fb0d4 9000+0 records in 9000+0 records out 9000 bytes (9.0 kB, 8.8 KiB) copied, 0.0319701 s, 282 kB/s CRC-32 checksum value for chunk [0, 0xffffffffffffffff): Mirror 1: 0xcc6bc578 Mirror 2: 0x72acf0a2 lfs mirror verify: chunk [0, 0xffffffffffffffff) has different checksum value on mirror 1 and mirror 2. 1+0 records in 1+0 records out 9000 bytes (9.0 kB, 8.8 KiB) copied, 0.0612341 s, 147 kB/s /mnt/lustre/d52.sanity-sec/f52.sanity-sec lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 104 0x68 0 /mnt/lustre/d52.sanity-sec/f52.sanity-sec lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 obdidx objid objid group 1 105 0x69 0 /mnt/lustre/d52.sanity-sec/f52.sanity-sec lcm_layout_gen: 2 lcm_mirror_count: 2 lcm_entry_count: 2 lcme_id: 65537 lcme_mirror_id: 1 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x69:0x0] } lcme_id: 131073 lcme_mirror_id: 2 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6a:0x0] } sanity-sec test_52: @@@@@@ FAIL: mirror extend file /mnt/lustre/d52.sanity-sec/f52.sanity-sec failed (3) Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6482:error() = /home/green/git/lustre-release/lustre/tests/sanity-sec.sh:4201:test_52() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6840:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6887:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6728:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-sec.sh:4236:main() Dumping lctl log to /tmp/testlogs//sanity-sec.test_52.*.1761317348.log rsync: chown "/tmp/testlogs/.sanity-sec.test_52.debug_log.oleg418-server.1761317348.log.ZxVYE9" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-sec.test_52.dmesg.oleg418-server.1761317348.log.vKpSmV" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped FAIL 52 (79s) == sanity-sec test 53: Mixed PAGE_SIZE clients =========== 10:49:24 (1761317364) SKIP: sanity-sec test_53 Need 64K PAGE_SIZE client SKIP 53 (4s) == sanity-sec test 54: Encryption policies with fscrypt == 10:49:28 (1761317368) /usr/bin/which: no fscrypt in (/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:) SKIP: sanity-sec test_54 This test needs fscrypt userspace tool SKIP 54 (4s) == sanity-sec test 55: access with seteuid =============== 10:49:32 (1761317372) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) mdt.lustre-MDT0000.identity_upcall=NONE On MGS 192.168.204.118, active = nodemap.active=1 waiting 10 secs for sync oleg418-server: error: c0 not existing nodemap name pdsh@oleg418-client: oleg418-server: ssh exited with exit code 1 On MGS 192.168.204.118, c0.id = waiting 10 secs for sync On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=1 waiting 10 secs for sync On MGS 192.168.204.118, c0.admin_nodemap = nodemap.c0.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, c0.trusted_nodemap = nodemap.c0.trusted_nodemap=1 waiting 10 secs for sync Starting client oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre Started clients oleg418-client.virtnet: 192.168.204.118@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) Initially root ruid:rgid 0:0, euid:egid 0:0 Groups 0 - root, To switch to effective sanityusr uid:gid 500:500 Groups 500 - sanityusr, Now root ruid:rgid 0:0, euid:egid 500:500 Groups 500 - sanityusr, File /mnt/lustre/d55.sanity-sec/sanityusr/testdir_groups/file successfully written 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) On MGS 192.168.204.118, default.admin_nodemap = nodemap.default.admin_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, default.trusted_nodemap = nodemap.default.trusted_nodemap=0 waiting 10 secs for sync On MGS 192.168.204.118, active = nodemap.active=0 waiting 10 secs for sync Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre PASS 55 (149s) == sanity-sec test 56: FIEMAP on encrypted file ========== 10:52:01 (1761317521) SKIP: sanity-sec test_56 skip ZFS backend SKIP 56 (5s) == sanity-sec test 57: security.c/encryption.c xattr protection ========================================================== 10:52:06 (1761317526) SKIP: sanity-sec test_57 skip ZFS backend SKIP 57 (4s) == sanity-sec test 58: access to enc file's xattrs ======= 10:52:10 (1761317530) SKIP: sanity-sec test_58 skip ZFS backend SKIP 58 (3s) == sanity-sec test 59a: mirror resync of encrypted files without key ========================================================== 10:52:14 (1761317534) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1+0 records in 1+0 records out 5000 bytes (5.0 kB, 4.9 KiB) copied, 0.000418515 s, 11.9 MB/s 1+0 records in 1+0 records out 5000 bytes (5.0 kB, 4.9 KiB) copied, 0.0941307 s, 53.1 kB/s /mnt/lustre/d59a.sanity-sec/f59a.sanity-sec lcm_layout_gen: 3 lcm_mirror_count: 2 lcm_entry_count: 2 lcme_id: 65537 lcme_mirror_id: 1 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6c:0x0] } lcme_id: 131074 lcme_mirror_id: 2 lcme_flags: init,stale lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6d:0x0] } 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped Chunks to be verified in /mnt/lustre/d59a.sanity-sec/UFshEI1aIZ9x0w7FFp03iA: [0, 0xffffffffffffffff) [1, 2] 2 Verifying chunk [0, 0xffffffffffffffff) on mirror: 1 2 CRC-32 checksum value for chunk [0, 0xffffffffffffffff): Mirror 1: 0xcdd95e03 Mirror 2: 0xcdd95e03 Verifying chunk [0, 0xffffffffffffffff) on mirror: 1 2 PASS lfs mirror read: cannot open '/mnt/lustre/d59a.sanity-sec/UFshEI1aIZ9x0w7FFp03iA': Required key not available Read the content of a specified mirror of a file. usage: lfs mirror read {--mirror-id|-N MIRROR_ID} [--outfile|-o ] lfs commands used to manage files with mirrored components: lfs mirror create - create a mirrored file or directory lfs mirror extend - add mirror(s) to an existing file lfs mirror split - split a mirror from an existing mirrored file lfs mirror resync - resynchronize out-of-sync mirrored file(s) lfs mirror read - read a mirror content of a mirrored file lfs mirror write - write to a mirror of a mirrored file lfs mirror copy - copy a mirror to other mirror(s) of a file lfs mirror verify - verify mirrored file(s) 549967909 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre Chunks to be verified in /mnt/lustre/d59a.sanity-sec/f59a.sanity-sec: [0, 0xffffffffffffffff) [1, 2] 2 Verifying chunk [0, 0xffffffffffffffff) on mirror: 1 2 CRC-32 checksum value for chunk [0, 0xffffffffffffffff): Mirror 1: 0x9818c8d6 Mirror 2: 0x9818c8d6 Verifying chunk [0, 0xffffffffffffffff) on mirror: 1 2 PASS 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 59a (40s) == sanity-sec test 59b: migrate/extend/split of encrypted files without key ========================================================== 10:52:54 (1761317574) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 9000+0 records in 9000+0 records out 9000 bytes (9.0 kB, 8.8 KiB) copied, 0.0408405 s, 220 kB/s 1+0 records in 1+0 records out 9000 bytes (9.0 kB, 8.8 KiB) copied, 0.134479 s, 66.9 kB/s /mnt/lustre/d59b.sanity-sec/f59b.sanity-sec lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 110 0x6e 0 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped /mnt/lustre/d59b.sanity-sec/A2I43roEgHbb0gPO,culqB lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 obdidx objid objid group 1 111 0x6f 0 402960251 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped /mnt/lustre/d59b.sanity-sec/A2I43roEgHbb0gPO,culqB lcm_layout_gen: 2 lcm_mirror_count: 2 lcm_entry_count: 2 lcme_id: 65537 lcme_mirror_id: 1 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 1 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6f:0x0] } lcme_id: 131073 lcme_mirror_id: 2 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 lmm_objects: - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x70:0x0] } sanity-sec test_59b: @@@@@@ FAIL: mirror extend file /mnt/lustre/d59b.sanity-sec/A2I43roEgHbb0gPO,culqB failed (4) Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6482:error() = /home/green/git/lustre-release/lustre/tests/sanity-sec.sh:4970:test_59b() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6840:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6887:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:6728:run_test() = /home/green/git/lustre-release/lustre/tests/sanity-sec.sh:5003:main() Dumping lctl log to /tmp/testlogs//sanity-sec.test_59b.*.1761317631.log rsync: chown "/tmp/testlogs/.sanity-sec.test_59b.debug_log.oleg418-server.1761317631.log.o4gn8n" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanity-sec.test_59b.dmesg.oleg418-server.1761317631.log.H8GLHL" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3] 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre FAIL 59b (63s) == sanity-sec test 59c: MDT migrate of encrypted files without key ========================================================== 10:54:02 (1761317642) SKIP: sanity-sec test_59c needs >= 2 MDTs SKIP 59c (3s) == sanity-sec test 60: Subdirmount of encrypted dir ====== 10:54:05 (1761317645) 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped 192.168.204.118@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre/d60.sanity-sec /mnt/lustre /mnt/lustre: total 12 drwxr-xr-x 2 root root 11264 Oct 24 10:54 3tRspPaA,q7HVinVIMTHSB -rw-r--r-- 1 root root 4096 Oct 24 10:54 xNPjiYND51L4oy8ze4T6sB /mnt/lustre/3tRspPaA,q7HVinVIMTHSB: total 1 -rw-r--r-- 1 root root 4096 Oct 24 10:54 FO4KSP5+gj3Cm0SQylzchC 260171533 192.168.204.118@tcp:/lustre/d60.sanity-sec /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock,test_dummy_encryption oleg418-server@tcp:/lustre/d60.sanity-sec /mnt/lustre /mnt/lustre: total 17 -rw-r--r-- 1 root root 2 Oct 24 10:54 file1 drwxr-xr-x 2 root root 11264 Oct 24 10:54 subdir /mnt/lustre/subdir: total 6 -rw-r--r-- 1 root root 2 Oct 24 10:54 subfile1 a b 192.168.204.118@tcp:/lustre/d60.sanity-sec /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,test_dummy_encryption=%s,test_dummy_encryption,encrypt 0 0 Stopping client oleg418-client.virtnet /mnt/lustre (opts:) Starting client: oleg418-client.virtnet: -o user_xattr,flock oleg418-server@tcp:/lustre /mnt/lustre 1 keys reaped PASS 60 (20s) == sanity-sec test 62: e2fsck with encrypted files ======= 10:54:26 (1761317666) SKIP: sanity-sec test_62 skip ZFS backend SKIP 62 (3s) cleanup: ====================================================== running as uid/gid/euid/egid 500/500/500/500, groups: [ls] [/mnt/lustre] d17.sanity-sec d18.sanity-sec d21.sanity-sec d35.sanity-sec d51.sanity-sec d55.sanity-sec d60.sanity-sec running as uid/gid/euid/egid 501/501/501/501, groups: [ls] [/mnt/lustre] d17.sanity-sec d18.sanity-sec d21.sanity-sec d35.sanity-sec d51.sanity-sec d55.sanity-sec d60.sanity-sec == sanity-sec test complete, duration 6087 sec =========== 10:54:31 (1761317671) sanity-sec: FAIL: test_52 mirror extend file /mnt/lustre/d52.sanity-sec/f52.sanity-sec failed (3) sanity-sec: FAIL: test_59b mirror extend file /mnt/lustre/d59b.sanity-sec/A2I43roEgHbb0gPO,culqB failed (4)