Re: [HTCondor-users] problem using custom Ads in htcondor.Submit object

[Jason Patton <jpatton@xxxxxxxxxxx>]

Hi Stefano,

Maybe you've already tried this, but does your example work any better if you use the MY.Attr syntax in your jdl dict instead of +Attr?

Jason

On Tue, Jun 4, 2024, 6:12âAM Stefano Belforte <stefano.belforte@xxxxxxx> wrote:

Dear experts,
sorry to report a new problem when migrating CMS CRAB to submit via
 schedd.submit(submitObject,...)

We add custom classAds to jobs for use in glideinWMS (which still works)
and we also add one which we use later on to use as a constrain
in condor_q, condor_qedit and other commads.

The latter thing fails. I have managed to reproduce to the problem
to a simple test using local submission with python bindings.

Hopefully lines below are self-explaining, if not, ask me.
Note in particular the output of
 condor_q 9620532 -af:h StefanoAd CRAB_TT
And of course the fact that condor_q -con .. does not select any job

Things look as expected if I put same info in a JDL file and do a plain
condor_submit test.jdl and also if I construct the htcondor.submit()
object passing the full jdl to it via ("""jdl lines"""). There are other
oddities,like if in the example below I change 'ROOT' to 'ROT' output
is different and while -con still fails, condor_q -af returns uniformly
"undefined". I can of course change ROOT to a different string in our
code, but it would be good to have a rational.

Our "old way" was to use schedd.submit(classAds,...)
and things were OK.

If you prefer to move this to some more interactive channel
(our GH ?) tell me as well.

Thanks a lot
Stefano

belforte@vocms059/T> condor_version
$CondorVersion: 23.0.4 2024-02-08 BuildID: 712251 PackageID: 23.0.4-1 $
$CondorPlatform: x86_64_AlmaLinux9 $

belforte@vocms059/T> cat mytest.py
import htcondor

schedd = htcondor.Schedd()

jdl = htcondor.Submit()
jdl['Universe']Â Â= "scheduler"
jdl['Executable'] = "None"
jdl['Log'] = "myTest.log"

jdl['+StefanoAd'] = "TestString"
jdl['+CRAB_TT'] = "ROOT"

print(jdl)

res = schedd.submit(jdl, count=1)
print(res.cluster())

belforte@vocms059/T> python3 mytest.py
Universe = scheduler
Executable = None
Log = myTest.log
MY.StefanoAd = TestString
MY.CRAB_TT = ROOT

9620532

belforte@vocms059/T> condor_q 9620532 -l|grep StefanoAd
StefanoAd = TestString
belforte@vocms059/T> condor_q 9620532 -l|grep CRAB_TT
CRAB_TT = ROOT
belforte@vocms059/T> condor_q 9620532 -af:h StefanoAd CRAB_TT
StefanoAd CRAB_TT
undefined [ ClusterId = 9620532; ProcId = 0; CRAB_TT = ROOT; StefanoAd =
TestString ]

belforte@vocms059/T> condor_q -con 'StefanoAd=="TestString"'


-- Schedd: crab3@xxxxxxxxxxxxxxxx : <188.184.103.189:4080?... @ 06/04/24
12:46:59
 ID   OWNER      SUBMITTED  ÂRUN_TIME ST PRI SIZE CMD

Total for query: 0 jobs; 0 completed, 0 removed, 0 idle, 0 running, 0
held, 0 suspended
Total for all users: 79 jobs; 3 completed, 0 removed, 0 idle, 76
running, 0 held, 0 suspended

belforte@vocms059/T> condor_q -con 'CRAB_TT=="ROOT"'


-- Schedd: crab3@xxxxxxxxxxxxxxxx : <188.184.103.189:4080?... @ 06/04/24
12:47:16
 ID   OWNER      SUBMITTED  ÂRUN_TIME ST PRI SIZE CMD

Total for query: 0 jobs; 0 completed, 0 removed, 0 idle, 0 running, 0
held, 0 suspended
Total for all users: 79 jobs; 3 completed, 0 removed, 0 idle, 76
running, 0 held, 0 suspended

belforte@vocms059/T>
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/