[HTCondor-users] token_key with remote accesspoint

["Weatherby,Gerard" <gweatherby@xxxxxxxx>]

Following the directions on https://htcondor.readthedocs.io/en/latest/man-pages/condor_token_create.html

>From the central manager, creating a key

 

condor_token_create -identity cweatherby@xxxxxxxxxx

generates a token I can put ~/cweatherby/.condor/tokens.d and run from both a dedicated accesspoint and a forwarding node.


after generating a key with

openssl rand -base64 32 | condor_store_cred -f /etc/condor/passwords.d/token_key

and a token with

condor_token_create -identity cweatherby@xxxxxxxxxx -key token_key

I can submit from the accesspoint, but not the forwarding node.

Forwarding node config.d/10_pool.conf:

CONDOR_HOST = condorcentralmanager.nmrbox.org

SCHEDD_HOST = accesspoint.nmrbox.org

and debug output from test submit on forwarding node

condor_submit -debug jobls

07/18/23 17:09:00 Result of reading /etc/issue:  Ubuntu 20.04.6 LTS \n \l

07/18/23 17:09:00 Using processor count: 4 processors, 4 CPUs, 0 HTs

07/18/23 17:09:00 Reading condor configuration from '/etc/condor/condor_config'

07/18/23 17:09:00 Enumerating interfaces: lo 127.0.0.1 up

07/18/23 17:09:00 Enumerating interfaces: ens160 155.37.253.166 up

07/18/23 17:09:00 Enumerating interfaces: lo ::1 up

07/18/23 17:09:00 Enumerating interfaces: ens160 fe80::250:56ff:feab:6ecc up

07/18/23 17:09:00 Will use TCP to update collector condorcentralmanager.nmrbox.org <155.37.253.160:9618?alias=condorcentralmanager.nmrbox.org>

07/18/23 17:09:00 Trying to query collector <155.37.253.160:9618?alias=condorcentralmanager.nmrbox.org>

07/18/23 17:09:00 Can't open directory "/etc/condor/passwords.d" as PRIV_ROOT, errno: 13 (Permission denied)

07/18/23 17:09:00 Can't open directory "/etc/condor/passwords.d" as PRIV_ROOT, errno: 13 (Permission denied)

07/18/23 17:09:00 Looking for tokens in directory /home/nmrbox/cweatherby/.condor/tokens.d for issuer condorcentralmanager.nmrbox.org

07/18/23 17:09:00 TOKEN: No token found.

07/18/23 17:09:00 SECMAN: required authentication with collector at <155.37.253.160:9618> failed, so aborting command QUERY_SCHEDD_ADS.

07/18/23 17:09:00 ERROR: AUTHENTICATE:1003:Failed to authenticate with any method|AUTHENTICATE:1004:Failed to authenticate using FS|AUTHENTICATE:1004:Failed to authenticate using IDTOKENS

 

ERROR: Can't find address of local schedd

Same submit from accesspoint:

condor_submit -debug jobls

07/18/23 17:15:36 Result of reading /etc/issue:  Ubuntu 20.04.6 LTS \n \l

07/18/23 17:15:36 Using processor count: 4 processors, 4 CPUs, 0 HTs

07/18/23 17:15:36 Reading condor configuration from '/etc/condor/condor_config'

07/18/23 17:15:36 Enumerating interfaces: lo 127.0.0.1 up

07/18/23 17:15:36 Enumerating interfaces: ens160 155.37.253.48 up

07/18/23 17:15:36 Enumerating interfaces: lo ::1 up

07/18/23 17:15:36 Enumerating interfaces: ens160 fe80::250:56ff:feab:baca up

Submitting job(s)07/18/23 17:15:36 SharedPortClient: sent connection request to local schedd for shared port id schedd_62119_0baf

07/18/23 17:15:36 Can't open directory "/etc/condor/passwords.d" as PRIV_ROOT, errno: 13 (Permission denied)

07/18/23 17:15:36 Can't open directory "/etc/condor/passwords.d" as PRIV_ROOT, errno: 13 (Permission denied)

07/18/23 17:15:36 Looking for tokens in directory /home/nmrbox/cweatherby/.condor/tokens.d for issuer condorcentralmanager.nmrbox.org

.

1 job(s) submitted to cluster 55.

07/18/23 17:15:36 SharedPortClient: sent connection request to local schedd for shared port id schedd_62119_0baf

These are shared filesystem nodes.