[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Support for ambient credentials in built-in S3 plugin



Hello, I am using Condor 9.0.16 on Windows and I am trying to use the
native S3 file transfer capabilities with an EC2 instance's ambient
credentials (via its instance profile) to write to an S3 bucket.

Right now, the only HTCondor tool that supports using credentials from the instance profile is condor_annex.

According to the Condor logs everything worked, but the files
are not in S3.

This seems wrong. IIRC, HTCondor doesn't ship with an S3-supporting plug-in, so file transfer should have failed when it couldn't find the corresponding plug-in. Do you have logs of a failed attempt? (If the log you sent is of a failed attempt, could you set STARTER_DEBUG = D_FULLDEBUG on the startd, and send the StarterLog? Thanks.)

- ToddM