[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Htcondor with python ray



Thanks Greg for your reply. Cant really find any stuff to integrate both.

Ray requires isolation in case of dynamic slots, and in case of static slots it will be less resource utilisation leading to higher costs for bigger VMs.Â

I was hoping to get some resources like Kuberay(combines kubernetes and ray and auto scale)

Thanks for your reply
Raman

On Tue, Nov 25, 2025, 00:16 Greg Thain via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:
On 11/24/25 08:42, Ram Ban wrote:
> Hi all,
>
> I am running htcondor 24 with dynamic allocation of resources on each
> machine, Is there any resources to connect htcondor with python ray,
> to use htcondor as auto scale for ray nodes.
>

Raman:

Many people use many different workflow managements systems (like dask,
snakemake, Task Vine, etc.) on top of HTCondor. I'm not aware of anyone
using Ray today, but I would not be surprised to learn of someone doing
so. Launch ray workers from an HTCondor job should be straightforward.

-greg


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe

The archives can be found at: https://www-auth.cs.wisc.edu/lists/htcondor-users/