Re: [HTCondor-users] Multiple queue statements in submit file.

[John M Knoeller <johnkn@xxxxxxxxxxx>]

The only tool that has ever supported multiple queue statements is condor_submit.  

But all of the submit methods support complex queue statements, which we added

to replace multiple queue statements. 

I would caution you about using Schedd.submitMany as is nearly impossible to use correctly and should probably be deprecated also.   

There is nothing you can do with schedd.submitMany() that you cannot also do with schedd.submit() with a Submit object and a complex queue statement.   

When the first argument of schedd.submit() is a Submit object, the job classads will be correctly constructed, something that is very hard to do by hand, and which changes with nearly every release. 

-tj

---

From: David Schultz <david.schultz@xxxxxxxxxxxxxxxx>
Sent: Wednesday, April 10, 2024 10:15 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc: John M Knoeller <johnkn@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Multiple queue statements in submit file.

 

Does this also affect the Python bindings?  I see multiple things are deprecated, but there is still htcondor.Schedd.submit() and htcondor.Schedd.submitMany().  I ask because I'm using submitMany() to be more efficient than calling submit() many times while varying about 10 ads per job.

Best,

David

On Wed, Apr 10, 2024 at 9:32âAM John M Knoeller via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

That is correct.  Multiple queue statements were made obsolete by the complex queue statement many years ago, but never actually removed from condor_submit. 

The other methods of submitting jobs  (python and dagman direct submit) have never supported multiple queue statements, and we intend to remove support for multiple queue statements from condor_submit in HTCondor 24. 

-tj

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Carles Acosta <cacosta@xxxxxx>
Sent: Wednesday, April 10, 2024 5:46 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] Multiple queue statements in submit file.

 

Dear all,

I found this thread because we have the same situation here. We have an advanced user who uses multiple queue statements in a single submit file and only the first one is submitted when using DAGMAN (HTCondor 23). 

If I understand correctly, this is not a bug and is expected behavior, right? In other words, for versions HTCondor > 9, the multiple queue statements are working with condor_submit but not with dagman, and in the next version, HTCondor 24, this functionality will be removed. 

Thank you in advance.

Best regards,

Carles

On Tue, 12 Mar 2024 at 20:52, Dudu Handelman <duduhandelman@xxxxxxxxxxx> wrote:

Thank you very much. 

Get Outlook for Android

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Cole Bollig via HTCondor-users <htcondor-users@xxxxxxxxxxx>
Sent: Tuesday, March 12, 2024 6:02:17 PM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc: Cole Bollig <cabollig@xxxxxxxx>
Subject: Re: [HTCondor-users] Multiple queue statements in submit file.

 

Hi David,

We are actually trying to phase out the use of multiple queue statements in a single submit file with a transition to the use of the for each queue statement. It should be easy to translate the multiple queue statements into a single queue statement as demonstrated in https://htcondor.readthedocs.io/en/latest/users-manual/submitting-a-job.html#submitting-many-similar-jobs-with-one-queue-command.

We plan to remove the functionality of multiple queue statements in the next major version (V24) feature series. 

-Cole Bollig

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Dudu Handelman <duduhandelman@xxxxxxxxxxx>
Sent: Monday, March 11, 2024 4:48 AM
To: htcondor-users@xxxxxxxxxxx <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] Multiple queue statements in submit file.

 

Hi All,

I have one user that using submit files which includes multiple queue which working as expected when using condor_submit.

But when submitting as a node in dag it submit only the first queue statements ( using htcondor > 9 ). 

Using htcondor 9.0 its submitting all the queue statements.

Is it valid to submit multiple queue statements via dag node?

Thanks

David

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

--

Carles Acosta i Silva

PIC (Port d'Informacià CientÃfica)

Campus UAB, Edifici D

E-08193 Bellaterra, Barcelona

Tel: +34 93 581 33 08

Fax: +34 93 581 41 10

http://www.pic.es 

AvÃs - Aviso - Legal Notice:  http://legal.ifae.es

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/