Re: [HTCondor-users] BUMP Re: curl file transfer problem

[Mark Coatsworth <coatsworth@xxxxxxxxxxx>]

Hi Dmitri,

Thanks for checking in. No need for other details. It's worth noting that your old file transfers were going via our squid proxies, which have been having problems recently causing jobs to get stuck. This looks like the same issue you're having. I don't know what state the proxies are in right now, but it's a known problem that we are working on.

As for adding timeouts to curl_plugin transfers: we've actually already added this, but it won't become available until the 8.9.2 release a few weeks from now. Big picture, we are actively working to make the curl_plugin more resilient to problems in the network. There are just lots of ways the network can misbehave, so it's a long process.

Mark

On Tue, Apr 23, 2019 at 11:32 AM Dmitri Maziuk via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

If anyone wants me to dig up more details, speak up now. I'm running a
kernel upgrade and rebooting this thing otherwise -- which of course
will kill all these stuck transfers and there'll be no more digging.

--
Dmitri Maziuk <dmaziuk@xxxxxxxxxxxxx>
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

--

Mark Coatsworth

Systems Programmer

Center for High Throughput Computing

Department of Computer Sciences

University of Wisconsin-Madison