Re: [HTCondor-users] using the Job Router for ARC CEs

[Maarten Litmaath <Maarten.Litmaath@xxxxxxx>]

Hi Brian,
direct submissions work OK, but I had not noticed the subtle change
in the attribute name:

NordugridRSL = "(queue=plugh)"

Will try with that now, thanks!

________________________________________
From: Brian Lin [blin@xxxxxxxxxxx]
Sent: 24 July 2020 17:22
To: HTCondor-Users Mail List; Maarten Litmaath
Subject: Re: [HTCondor-users] using the Job Router for ARC CEs

Hi Maarten,

I can't say I'm familiar with nordugrid submission but have you gotten
regular submission to an ARC CE working with the following in a submit file?

     nordugrid_rsl = (queue=plugh)

The above treats "nordugrid_rsl" as a submit command, i.e. something
that condor_submit takes and applies logic to construct one or more
attributes in the resultant job ad, whereas "+nordugrid_rsl" will add
the "nordugrid_rsl" attribute directly to the job ad.

Once you have successful submission that way, then you can inspect the
ad (condor_q -l) for the names of the attributes that are populated with
the specified RSL and use that in your JobRouter configuration.

- Brian

On 7/24/20 9:58 AM, Maarten Litmaath wrote:
> No luck yet: once a string, always a string...
>
> ________________________________________
> From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on behalf of Maarten Litmaath [Maarten.Litmaath@xxxxxxx]
> Sent: 24 July 2020 16:37
> To: HTCondor-Users Mail List
> Subject: Re: [HTCondor-users] using the Job Router for ARC CEs
>
> Hi all,
> I will try using substr() or other suggestions from the classad docs...
>
> ________________________________________
> From: HTCondor-users [htcondor-users-bounces@xxxxxxxxxxx] on behalf of Maarten Litmaath [Maarten.Litmaath@xxxxxxx]
> Sent: 24 July 2020 16:00
> To: HTCondor-Users Mail List ‎[htcondor-users@xxxxxxxxxxx]‎
> Subject: [HTCondor-users] using the Job Router for ARC CEs
>
> Dear HTCondor users,
> I am trying to configure the Job Router for ARC CEs (type "nordugrid"),
> but did not manage to get the destination queue specification working.
>
> I tried to imitate what is shown for Globus in the example configuration:
>
> https://htcondor.readthedocs.io/en/latest/grid-computing/job-router.html#an-example-configuration
>
> The Job Router accepts the following, lines folded for clarity:
>
> ==========
> 07/24/20 14:41:19 Parsing JOB_ROUTER_ENTRIES_CMD=[
> GridResource = "nordugrid arc-ce.some.domain";
> eval_set_GridResource = "nordugrid arc-ce.some.domain";
> eval_set_nordugrid_rsl = "(queue=plugh)" ]
>
> 07/24/20 14:41:19 JobRouter Note: adding new route '[
> set_remote_jobuniverse = 5;
> eval_set_nordugrid_rsl = "(queue=plugh)";
> MaxIdleJobs = 200; EditJobInPlace = true; MaxJobs = 20000;
> GridResource = "nordugrid arc-ce.some.domain";
> set_JobUniverse = 9;
> eval_set_GridResource = "nordugrid arc-ce.some.domain";
> delete_JobLeaseDuration = true;
> requirements = target.WantJobRouter is true;
> delete_WantJobRouter = true ]'
> ==========
>
> In the output of "condor_q -l" for a routed job I then see this line:
>
> nordugrid_rsl = "(queue=plugh)"
>
> So far so good, yet the ARC CE reports there is no queue defined:
>
> HoldReason = "globus_ftp_client: the server responded with an error
> 451 Request has no queue defined."
>
> Indeed, the HTCondor documentation for the "nordugrid" type does
> not have double quotes in the "nordugrid_rsl" specification:
>
> https://htcondor.readthedocs.io/en/latest/grid-computing/grid-universe.html#the-nordugrid-grid-type
>
> So, it seems the ARC CE is exactly getting the RHS of that expression
> and cannot deal with it.  Right, let's try without the double quotes then:
>
> ==========
> 07/24/20 14:40:19 Parsing JOB_ROUTER_ENTRIES_CMD=[
> GridResource = "nordugrid arc-ce.some.domain";
> eval_set_GridResource = "nordugrid arc-ce.some.domain";
> eval_set_nordugrid_rsl = (queue=plugh) ]
>
> 07/24/20 14:40:19 JobRouter CONFIGURATION ERROR:
> Ignoring the malformed route entry in JOB_ROUTER_ENTRIES_CMD,
> at offset 0 starting here:
> [ GridResource = "nordugrid arc-ce.some.domain"; eval_set_GridResource = "no
> ==========
>
> Now it appears the Job Router cannot accept a bare RHS...
>
> Is there a "trick" to get the correct syntax into the JDL via the Job Router?
>
>
>
> I have already tried using a '+' definition in the original JDL instead;
> the following is accepted, but has the same issue with the double quotes:
>
> +nordugrid_rsl = "(queue=plugh)"
>
> Without the double quotes it is rejected by condor_submit:
>
> ERROR: Parse error in expression:
>          nordugrid_rsl = (queue=plugh)
>
>
>
> Thanks for any tips!
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/