[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Wrapper/Knobs to "tune" GPU power limit (nvidia-smi -pl) per Job



On 2/13/26 08:49, Joachim Meyer wrote:

Hi,

we have a request from users to be able to "tune" a few machine variables, like set a power or frequency cap on the GPU via nvidia-smi. As far as I understand, these commands do need root access. E.g. "sudo nvidia-smi -i 0 -pl 300W" would reduce the power limit to 300W.


Hi Joachim:

We do not have a good way to do this. The USER_JOB_WRAPPER might be able to do this, but it does not have root privilege. In theory, one could right a setuid script that lowers the wattage of the gpu that you could put into the USER_JOB_WRAPPER, but I will leave it to you if that is a risk you'd be willing to take.

-greg