Re: [HTCondor-users] What is the meaning of "TotalSubmitProcs" for parallel universe jobs?

[John M Knoeller <johnkn@xxxxxxxxxxx>]

> My hypothesis is that this tells condor to require 32 target slots *at the same time* but I'm not 100% sure as I cannot find any information about this.

That is correct.

PARALLEL universe means that all of the jobs are started at the same time.  Schedd will claim resources as they become available, but not actually tell the job to start until it has N claims at the same time, where N is the number of "jobs" that were

submitted.   TotalSubmitProcs will be that number, but that attribute isn't meant to be used with parallel universe jobs. 

PARALLEL universe requires each execute node to designate a Schedd to act as the DEDICATED_SCHEDULER for

the purpose of coordinating the start of the procs of the parallel universe submit. 

Setting Up for Special Environments — HTCondor Manual 10.0.9 documentation

A PARALLEL universe job submitted to a Schedd that is not the dedicated scheduler for the necessary quantity of execution cores will  just sit idle forever. 

-tj

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Carsten Aulbert <carsten.aulbert@xxxxxxxxxx>
Sent: Monday, February 24, 2025 8:08 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] What is the meaning of "TotalSubmitProcs" for parallel universe jobs?

 

Hi all,

as

https://htcondor.readthedocs.io/en/latest/search.html?q=TotalSubmitProcs&check_keywords=yes&area=default#

does not yield anything and a broader search only shows a changelog
entry for condor 10, what is the meaning of TotalSubmitProcs?

Background:

A user submitted a parallel universe job with "Queue 32" and those jobs
sit idle in the queue while other jobs are running happily.

condor_q -better shows

"Job has not yet been considered by the matchmaker."

while theoretically a number of nodes (but less than 32!) would even
match the jobs' requirement.

My hypothesis is that this tells condor to require 32 target slots *at
the same time* but I'm not 100% sure as I cannot find any information
about this.

Can you enlighten me, please? ;-)

Cheers

Carsten

--
Dr. Carsten Aulbert, Max Planck Institute for Gravitational Physics,
Callinstraße 38, 30167 Hannover, Germany, Phone +49 511 762 17185