Re: [HTCondor-users] GPU ressource usage

[Valerio Bellizzomi <valerio@xxxxxxxxxx>]

On Mon, 2019-04-29 at 14:36 +0000, John M Knoeller wrote:
> condor_gpu_utilization uses the nvml library, which is specific to CUDA. 
> -tj


Thanks. Okay, so this question becomes a feature request: gpu monitor
for OpenCL.

Valerio Bellizzomi




> -----Original Message-----
> From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> On Behalf Of Valerio Bellizzomi
> Sent: Monday, April 29, 2019 8:57 AM
> To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
> Subject: Re: [HTCondor-users] GPU ressource usage
> 
> On Mon, 2019-04-29 at 13:08 +0000, Todd Tannenbaum wrote:
> > 
> > > On Apr 29, 2019, at 7:30 AM, Beyer, Christoph <christoph.beyer@xxxxxxx> wrote:
> > > 
> > > Hi,
> > > 
> > > I just aded a couple of GPU-hosts in my pool and I wonder if there is an easy way to get information about the actual usage of the gPU possibly out of the history file of the job ? 
> > > 
> > > Maybe there is some tweaking needed to do this but I would definetely like to know if and how intense the gPU tagged jobs actually used the GPU .... 
> > > 
> > > Any hints someone ? :) 
> > > 
> > > Best
> > > Christoph
> > > 
> > 
> > Hi Christoph,
> > 
> > HTCondor 8.8.2+ (and thus 8.9.1+) includes GPU monitoring fixes, and monitors both GPU core processing utilization and memory utilization .  To enable GPU monitoring in either release,
> > add the following line to your configuration:
> > 
> > use feature: GPUsMonitor
> > 
> > You should then get some helpful GPU utilization attributes in the history classad. 
> > 
> > Best regards
> > Todd
> 
> Greetings,
> I have read that this monitoring works for CUDA GPUs, does this work for
> OpenCL too (AMD GPUs) ?
> 
> 
> > 
> > 
> > 
> > > -- 
> > > Christoph Beyer
> > > DESY Hamburg
> > > IT-Department
> > > 
> > > Notkestr. 85
> > > Building 02b, Room 009
> > > 22607 Hamburg
> > > 
> > > phone:+49-(0)40-8998-2317
> > > mail: christoph.beyer@xxxxxxx
> > > _______________________________________________
> > > HTCondor-users mailing list
> > > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> > > subject: Unsubscribe
> > > You can also unsubscribe by visiting
> > > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> > > 
> > > The archives can be found at:
> > > https://lists.cs.wisc.edu/archive/htcondor-users/
> > 
> > _______________________________________________
> > HTCondor-users mailing list
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> > 
> > The archives can be found at:
> > https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> 
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
> 
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/