[HTCondor-users] Setting Python 3.13 env var PYTHON_CPU_COUNT in HTCondor?

[Joachim Meyer <jmeyer@xxxxxxxxxxxxxxxxxx>]

Hi,

Python 3.13 will introduce PYTHON_CPU_COUNT as a configuration variable to override the `os.cpu_count()` (and friends) return value (https://github.com/python/cpython/commit/0362cbf908aff2b87298f8a9422e7b368f890071).

We've seen it a number of times that the users use `os.cpu_count()` to determine how many "subprocesses" they may launch.

This obviously blows the CPU load completely when having multiple jobs that only request 16 cores but start 256 processes...

So, I'm wondering, should HTCondor set PYTHON_CPU_COUNT to alleviate this for future Python versions?

Also, if you know workarounds that already work with released Python versions, I'm happy to learn about them!

Best,

- Joachim Meyer

--

Joachim Meyer

HPC-Koordination & Support

Universität des Saarlandes

FR Informatik | HPC

Postanschrift: Postfach 15 11 50 | 66041 Saarbrücken

Besucheranschrift: Campus E1 3 | Raum 4.03

66123 Saarbrücken

T: +49 681 302-57522

jmeyer@xxxxxxxxxxxxxxxxxx

www.uni-saarland.de