Hi Daniel,
Looks like the TRUST_DOMAIN is being set by the configuration template SECURITY:get_htcondor_idtokens set in 02-submitter-host.config. This is happening because the configuration directory files are parsed in lexicographical order (02-submitter-host.config is parsed after 01-central-manager.config) and the last value wins. So, either set TRUST_DOMAIN after the configuration template in 02-submitter-host.config or add the configuration to a different file that is parsed later i.e. 03-new-file.config
Cheers,Cole Bollig
From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Daniel BrÃckner <daniel.brueckner@xxxxxxxxxxxxxxxxxx>
Sent: Monday, August 12, 2024 12:27 PM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Trying to set up High-Availability Cluster - Issues with IDTOKENSÂHmm. Nah. :-(
####condor_config_val -v TRUST_DOMAIN
TRUST_DOMAIN = cm1.domain.name, cm2.domain.name
Â# at: /etc/condor/config.d/02-submitter-host.config, line 1, use SECURITY:get_htcondor_idtokens+42
Â# raw: TRUST_DOMAIN = $(CONDOR_HOST)
####
####cat /etc/condor/config.d/02-submitter-host.config
use role : get_htcondor_submit
####
Does one of the predefined roles ( like "use role : get_htcondor_submit" or "use role:get_htcondor_central_manager") cause this behavior? Is the setting "use security:recommended_v9_0" deprecated?
Best regards,
Daniel
On 12.08.2024 17:11, John M Knoeller via HTCondor-users wrote:
You can run
 Âcondor_config_val -v TRUST_DOMAIN
to see what file this variable is set in. Â
Most likely it is set in a later config file then the one you changed.Â
-tj
From:ÂHTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Daniel BrÃckner <daniel.brueckner@xxxxxxxxxxxxxxxxxx>
Sent:ÂMonday, August 12, 2024 8:08 AM
To:ÂHTCondor-Users Mail List <HTCondor-users@xxxxxxxxxxx>
Subject:ÂRe: [HTCondor-users] Trying to set up High-Availability Cluster - Issues with IDTOKENSÂI got the hint to set the macro "TRUST_DOMAIN" manually, since it's default is TRUST_DOMAIN = $(CONDOR_HOST). But unfortunately I'm not able to change this macro. After restarting the service it shows the default value, again.
####condor_config_val TRUST_DOMAIN cm1.test.de, cm2.test.de####
########condor_config_val -dump TRUST # Configuration from machine: cm1.domain.name # Parameters with names that match TRUST: BOOTSTRAP_SSL_SERVER_TRUST = false BOOTSTRAP_SSL_SERVER_TRUST_PROMPT_USER = true QUEUE_ALL_USERS_TRUSTED = false TRUST_DOMAIN = $(CONDOR_HOST) TRUST_DOMAIN_CAFILE = /etc/condor/trust_domain_ca.pem TRUST_DOMAIN_CAKEY = /etc/condor/trust_domain_ca_privkey.pem TRUST_LOCAL_UID_DOMAIN = true TRUST_UID_DOMAIN = # Contributing configuration file(s): # Â Â Â /etc/condor/condor_config # Â Â Â /etc/condor/config.d/00-htcondor-9.0.config # Â Â Â /etc/condor/config.d/01-central-manager.config # Â Â Â /etc/condor/config.d/02-submiter-host.config # Â Â Â /etc/condor/config.d/10-stash-plugin.conf # Â Â Â /etc/condor/condor_config.local
####grep -rnwi /etc/condor/ -e "TRUST_DOMAIN" /etc/condor/config.d/01-central-manager.config:2:TRUST_DOMAIN = "domain.name"####
Any ideas?
Best regards,
Daniel
On 12.08.2024 11:59, Daniel BrÃckner wrote:Hello,
I'm trying to set up a high availability central manager pool following this steps described here:
https://htcondor.readthedocs.io/en/lts/admin-manual/high-availability.html
I installed two identical nodes, but they are not able to communicate.
######
08/12/24 11:41:56 DC_AUTHENTICATE: required authentication of x.x.x.3 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXwWFJF8)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
######
Even my computing nodes are not able to connect to any of the CMs using this configuration:
######
08/12/24 11:45:04 DC_AUTHENTICATE: required authentication of x.x.x.70 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXHdRQPA)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
08/12/24 11:45:04 DC_AUTHENTICATE: required authentication of x.x.x.70 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXNHZucb)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
08/12/24 11:45:13 DC_AUTHENTICATE: required authentication of x.x.x.66 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXzHgGgP)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
08/12/24 11:45:13 DC_AUTHENTICATE: required authentication of x.x.x.66 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXmqwPKw)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
08/12/24 11:45:18 DC_AUTHENTICATE: required authentication of x.x.x.66 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXG0Kexg)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
08/12/24 11:45:18 DC_AUTHENTICATE: required authentication of x.x.x.66 failed: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|FS:1004:Unable to lstat(/tmp/FS_XXXh1xYgK)|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS
######I'm using this configuration macro:
CENTRAL_MANAGER1 = cm1.domain.name CENTRAL_MANAGER2 = cm2.domain.name CONDOR_HOST = $(CENTRAL_MANAGER1),$(CENTRAL_MANAGER2) When I changed CONDOR_HOST to a single host entry, everything works fine: "CONDOR_HOST = $(CENTRAL_MANAGER1)" or "CONDOR_HOST = $(CENTRAL_MANAGER2)" While setting up a token for my 2nd CM, I got this error: ##### condor_token_create -identity condor@xxxxxxxxxxxxxxx Failed to generate a token. PASSWD:1:Issuer namespace may not contain spaces or commas ##### After changing to "CONDOR_HOST = $(CENTRAL_MANAGER2)" I was able to create this token. I guess there's an issue using the macro "CONDOR_HOST" with two or more hosts when using Tokens. Can anybody confirm this? How can I change my configuration to get things working? Thanks for your help, Daniel
_______________________________________________ HTCondor-users mailing list To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a subject: Unsubscribe You can also unsubscribe by visiting https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users The archives can be found at: https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________ HTCondor-users mailing list To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a subject: Unsubscribe You can also unsubscribe by visiting https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users The archives can be found at: https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________ HTCondor-users mailing list To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a subject: Unsubscribe You can also unsubscribe by visiting https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users The archives can be found at: https://lists.cs.wisc.edu/archive/htcondor-users/
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature