== recovery-small test 180a: GSSIAM recovery keeps user principal permission ========================================================== 20:56:15 (1788742575) debug=+sec debug=+sec mdt.lustre-MDT0000.enable_remote_dir_gid=-1 mdt.lustre-MDT0001.enable_remote_dir_gid=-1 fail_loc=0x1205 On MGS 192.168.201.129, active = nodemap.active=1 sptlrpc.gssiam.gssiam_upcall=/home/green/git/lustre-release/lustre/utils/gss/l_gssiam_upcall sptlrpc.gssiam_server.gssiam_auth_upcall=/home/green/git/lustre-release/lustre/utils/gss/l_gssiam_auth sptlrpc.gssiam_server.gssiam_flush=-1 sptlrpc.gssiam.gssiam_flush=-1 sptlrpc.gssiam.gssiam_flush=-1 Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam pdsh@oleg129-client: oleg129-server: ssh exited with exit code 2 pdsh@oleg129-client: oleg129-client: ssh exited with exit code 5 checking cli2mdt...found 0/2 gssiam connections checking cli2mdt...found 0/2 gssiam connections checking cli2mdt...found 0/2 gssiam connections checking cli2mdt...found 0/2 gssiam connections checking cli2mdt...found 2/2 gssiam connections Stopping clients: oleg129-client.virtnet /mnt/lustre (opts:) Stopping client oleg129-client.virtnet /mnt/lustre opts: Starting client oleg129-client.virtnet: -o user_xattr,flock,user_principal=mock_gssiam_rw 192.168.201.129@tcp:/lustre/d180a.recovery-small /mnt/lustre Mount client oleg129-client.virtnet: mount -t lustre -o user_xattr,flock,user_principal=mock_gssiam_rw 192.168.201.129@tcp:/lustre/d180a.recovery-small /mnt/lustre Started clients oleg129-client.virtnet: 192.168.201.129@tcp:/lustre/d180a.recovery-small on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_principal=mock_gssiam_rw,user_xattr,verbose) Failing mds1 on oleg129-server Stopping /mnt/lustre-mds1 (opts:) on oleg129-server 20:57:02 (1788742622) shut down facet: mds1 facet_host: oleg129-server facet_failover_host: oleg129-server Failover mds1 to oleg129-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg129-server: oleg129-server.virtnet: executing set_default_debug -1 all pdsh@oleg129-client: oleg129-server: ssh exited with exit code 1 Started lustre-MDT0000 20:57:24 (1788742644) targets are mounted 20:57:24 (1788742644) facet_failover done oleg129-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec /mnt/lustre/before has type dir OK Stopping clients: oleg129-client.virtnet /mnt/lustre (opts:) Stopping client oleg129-client.virtnet /mnt/lustre opts: Starting client oleg129-client.virtnet: -o user_xattr,flock,user_principal=mock_gssiam_ro 192.168.201.129@tcp:/lustre/d180a.recovery-small /mnt/lustre Mount client oleg129-client.virtnet: mount -t lustre -o user_xattr,flock,user_principal=mock_gssiam_ro 192.168.201.129@tcp:/lustre/d180a.recovery-small /mnt/lustre Started clients oleg129-client.virtnet: 192.168.201.129@tcp:/lustre/d180a.recovery-small on /mnt/lustre type lustre (ro,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_principal=mock_gssiam_ro,user_xattr,verbose) /mnt/lustre/f180a.recovery-small has type file OK mkdir: cannot create directory '/mnt/lustre/ro': Read-only file system Failing mds1 on oleg129-server Stopping /mnt/lustre-mds1 (opts:) on oleg129-server 20:57:36 (1788742656) shut down facet: mds1 facet_host: oleg129-server facet_failover_host: oleg129-server Failover mds1 to oleg129-server mount facets: mds1 Start mds1: mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 oleg129-server: oleg129-server.virtnet: executing set_default_debug -1 all pdsh@oleg129-client: oleg129-server: ssh exited with exit code 1 Started lustre-MDT0000 20:57:57 (1788742677) targets are mounted 20:57:57 (1788742677) facet_failover done oleg129-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec /mnt/lustre/f180a.recovery-small has type file OK mcreate: cannot create `/mnt/lustre/f180a.recovery-small.2' with mode 0100644: Read-only file system Stopping clients: oleg129-client.virtnet /mnt/lustre (opts:) Stopping client oleg129-client.virtnet /mnt/lustre opts: Starting client oleg129-client.virtnet: -o user_xattr,flock 192.168.201.129@tcp:/lustre /mnt/lustre Mount client oleg129-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.129@tcp:/lustre /mnt/lustre Started clients oleg129-client.virtnet: 192.168.201.129@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=null Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=null checking cli2mdt...found 0/2 null connections checking cli2mdt...found 0/2 null connections checking cli2mdt...found 0/2 null connections checking cli2mdt...found 2/2 null connections sptlrpc.gssiam.gssiam_flush=-1 sptlrpc.gssiam.gssiam_flush=-1 sptlrpc.gssiam_server.gssiam_flush=-1 sptlrpc.gssiam_server.gssiam_auth_upcall=/usr/sbin/l_gssiam_auth sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall On MGS 192.168.201.129, active = nodemap.active=0 Stopping clients: oleg129-client.virtnet /mnt/lustre (opts:) Stopping client oleg129-client.virtnet /mnt/lustre opts: Starting client oleg129-client.virtnet: -o user_xattr,flock 192.168.201.129@tcp:/lustre /mnt/lustre Mount client oleg129-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.201.129@tcp:/lustre /mnt/lustre Started clients oleg129-client.virtnet: 192.168.201.129@tcp:/lustre on /mnt/lustre type lustre (rw,flock,checksum,encrypt,lazystatfs,lruresize,nolock,statfs_project,nosync_on_close,nouser_fid2path,user_xattr,verbose) fail_loc=0