[HTCondor-users] condor_adstash unable to fetch startd histrories - Failed to authenticate with any method

[Alec Sheperd <alec.sheperd@xxxxxxxxxxxxxxxx>]

Hi,

I've been trying to test out using condor_adstash to dump startd metrics to our elasticsearch, but have been getting authentication errors when the script tries to query the startds themselves. Currently using condor 10.0.9.

multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
 File "/usr/lib64/python3.6/multiprocessing/pool.py", line 119, in worker
  result = (True, func(*args, **kwds))
 File "/usr/libexec/condor/adstash/adstash.py", line 198, in startd_history_processor
  ads = src.fetch_ads(startd_ad, max_ads=args.startd_history_max_ads)
 File "/usr/libexec/condor/adstash/ad_sources/startd_history.py", line 42, in fetch_ads
  return startd.history(requirements=True, projection=[], **history_kwargs)
 File "/usr/lib64/python3.6/site-packages/htcondor/_lock.py", line 70, in wrapper
  rv = func(*args, **kwargs)
htcondor.HTCondorIOError: Failed to authenticate with any method

Our pool primarily runs as glideins on grid resources/flocking to other pools. It seems like what is happening is that when the collector is queried for the startd ads, that is fine as the collector can access those daemons ads. But trying to directly access the startds themselves isn't able to authenticate. Is there a mechanism or way to query the startd ads directly from the collector in condor_adstash? Or is there perhaps some other configuration method I can set to access the startds directly? Our primary authentication method is IDTOKEN, so perhaps there is a way to configure that properly for adstash?

Alec