Re: [HTCondor-users] HTCondor Cluster within Slurm Job

[Stefano Dal Pra <stefano.dalpra@xxxxxxxxxxxx>]

Hello Leslie, we worked on that (https://doi.org/10.1051/epjconf/202024509009) to integrate a HPC clusters with WLCG payloads.
in a (compressed) nutshell: a htcondor-ce routes jobs to a Slurm cluster. At start, these jobs launch a startd who join a condor pool.

Stefano



On 29/09/21 21:49, Leslie Hart - NOAA Federal via HTCondor-users wrote:

Hi,

Is it possible (and is there an existing recipe) to start up a "private" HTCondor Cluster within a Slurm job. We have users who would like to allocate a number of nodes and then use those nodes as an HT cluster for the duration of the job. Ideally, we could supply a few commands that they would use at the beginning and end of their Slurm batch job to start and shutdownÂthe cluster (the middle would be comprised of a series of HTCondor jobs, of course. e.g. HTCondorStart (would figure out the nodes that Slurm has allocated and create the cluster). HTCondorWait (would wait until all HTCondor jobs completer) and HTCondorFinish (would gracefully shut down HTCondor).

Thanks,

Leslie Hart

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/