Re: [HTCondor-users] Multiple queue statements in submit file.

[David Schultz <david.schultz@xxxxxxxxxxxxxxxx>]

One challenging case for submit() is if one job has a classad that is not present in another, specifically with resource requests where when not present it should use the default defined by schedd job transforms. I guess I could set it to classad.Value.Undefined in the itemdata? Or would python's None work?

I also note that the docs around itemdata seem lacking (entirely missing in the schedd.submit() api docs, and with a single example in the advanced tutorial).

David

On Wed, Apr 10, 2024 at 12:38âPM John M Knoeller <johnkn@xxxxxxxxxxx> wrote:

The only tool that has ever supported multiple queue statements is condor_submit.ÂÂ

But all of the submit methods support complex queue statements, which we added

to replace multiple queue statements.Â

I would caution you about using Schedd.submitMany as is nearly impossible to use correctly and should probably be deprecated also. Â

There is nothing you can do with schedd.submitMany() that you cannot also do with schedd.submit() with a Submit object and a complex queue statement. Â

When the first argument of schedd.submit() is a Submit object, the job classads will be correctly constructed, something that is very hard to do by hand, and which changes with nearly every release.Â

-tj

---

From:ÂDavid Schultz <david.schultz@xxxxxxxxxxxxxxxx>
Sent:ÂWednesday, April 10, 2024 10:15 AM
To:ÂHTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc:ÂJohn M Knoeller <johnkn@xxxxxxxxxxx>
Subject:ÂRe: [HTCondor-users] Multiple queue statements in submit file.

Â

Does this also affect the Python bindings? I see multiple things are deprecated, but there is still htcondor.Schedd.submit() and htcondor.Schedd.submitMany(). I ask because I'm using submitMany() to be more efficient than calling submit() many times while varying about 10 ads per job.

Best,

David

On Wed, Apr 10, 2024 at 9:32âAM John M Knoeller via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

That is correct. Multiple queue statements were made obsolete by the complex queue statement many years ago, but never actually removed from condor_submit.Â

The other methods of submitting jobs (python and dagman direct submit) have never supported multiple queue statements, and we intend to remove support for multiple queue statements from condor_submit in HTCondor 24.Â

-tj

---

From:ÂHTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Carles Acosta <cacosta@xxxxxx>
Sent:ÂWednesday, April 10, 2024 5:46 AM
To:ÂHTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject:ÂRe: [HTCondor-users] Multiple queue statements in submit file.

Â

Dear all,

I found this thread because we have the same situation here. We have an advanced user who uses multiple queue statements in a single submit file and only the first one is submitted when using DAGMAN (HTCondor 23).Â

If I understand correctly, this is not a bug and is expected behavior, right? In other words, for versions HTCondor > 9, the multiple queue statements are working with condor_submit but not withÂdagman, and in the next version, HTCondor 24, this functionality will be removed.Â

Thank you in advance.

Best regards,

Carles

On Tue, 12 Mar 2024 at 20:52, Dudu Handelman <duduhandelman@xxxxxxxxxxx> wrote:

Thank you very much.Â

Get Outlook for Android

---

From:ÂHTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Cole Bollig via HTCondor-users <htcondor-users@xxxxxxxxxxx>
Sent:ÂTuesday, March 12, 2024 6:02:17 PM
To:ÂHTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Cc:ÂCole Bollig <cabollig@xxxxxxxx>
Subject:ÂRe: [HTCondor-users] Multiple queue statements in submit file.

Â

Hi David,

We are actually trying to phase out the use of multiple queue statements in a single submit file with a transition to the use of the for each queue statement. It should be easy to translate the multiple queue statements into a single queue statement as demonstrated in https://htcondor.readthedocs.io/en/latest/users-manual/submitting-a-job.html#submitting-many-similar-jobs-with-one-queue-command.

We plan to remove the functionality of multiple queue statements in the next major version (V24) feature series.Â

-Cole Bollig

---

From:ÂHTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Dudu Handelman <duduhandelman@xxxxxxxxxxx>
Sent:ÂMonday, March 11, 2024 4:48 AM
To: htcondor-users@xxxxxxxxxxxÂ<htcondor-users@xxxxxxxxxxx>
Subject:Â[HTCondor-users] Multiple queue statements in submit file.

Â

Hi All,

I have one user that using submit files which includes multiple queue which working as expected when using condor_submit.

But when submitting as a node in dag it submit only the first queue statements ( using htcondor > 9 ).Â

Using htcondor 9.0 its submitting all the queue statements.

Is it valid to submit multiple queue statements via dag node?

Thanks

David

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxxÂwith a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/

--

Carles Acosta i Silva

PIC (Port d'Informacià CientÃfica)

Campus UAB, Edifici D

E-08193 Bellaterra, Barcelona

Tel: +34 93 581 33 08

Fax: +34 93 581 41 10

http://www.pic.esÂ

AvÃs - Aviso - Legal Notice: Âhttp://legal.ifae.es

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxxÂwith a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/