Re: [HTCondor-users] OOM & HTCondor 10 job submission to ARC-CE on CentOS7

[Petr Vokac <petr.vokac@xxxxxxx>]

Updating just curl might be easier (faster to deploy) than moving whole 
submission infrastructure to new OS. We did not really replaced OS curl, but
> made a wrapper of arc_gahp to launch with the library from 
> libcurl-openssl instead of OS's libcurl. It works indeed to reduce the 
> memory usage/leak. I deployed it to all condor 10 nodes.
With this workaround ATLAS finished deployment of HTCondor 10 on our 
grid job submission side.

XRootD had also problems with this libcurl, not sure if that was same 
issue (Brian might have more details).

This libcurl linked with nss on CentOS7 caused so much troubles in the 
past (e.g. Rucio also used replacement linked with openssl) that moving 
away from CentOS7 might be the best option.

Petr

On 5/5/23 22:58, Jaime Frey via HTCondor-users wrote:
> We donât have a solution for this memory leak on CentOS7 at present. We are considering some workarounds within the our code, and may a solution in a future release.
>
> Iâd be happy to update the HTCONDOR-1685 JIRA ticket with more details and a mention of updated curl package youâre using.
>
>   - Jaime
>
> > On May 2, 2023, at 7:14 AM, Petr Vokac <petr.vokac@xxxxxxx> wrote:
> >
> > Hi,
> >
> > should we consider job submission to ARC-CE unsupported with HTCondor 10 running on CentOS7 as described in https://opensciencegrid.atlassian.net/browse/HTCONDOR-1685? We [1] had to apply workaround [2] and forced arc_gahp to use different curl libraries not to face OOM issues.
> >
> > I'm complaining here, because several people independently discovered (wasted time with) this issue and I'm not able to comment JIRA ticket.
> >
> > Petr
> >
> > [1] https://its.cern.ch/jira/browse/ATLASPANDA-791
> > [2] https://linuxsoft.cern.ch/cern/centos/7/cern/x86_64/Packages/curl-openssl-7.57.0-1.1.el7.cern.x86_64.rpm
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/