Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Using VARS with SPLICE in DAGMan
- Date: Tue, 8 Jan 2013 18:40:56 -0600
- From: Nathan Panike <nwp@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Using VARS with SPLICE in DAGMan
Hi Chris,
This is implemented in the current 7.9 development series.
See https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=1780
Nathan Panike
On Tue, Jan 08, 2013 at 06:01:07PM -0500, Christopher Martin wrote:
> I'm looking at SPLICE in DAGMan and I'm curious if you can use CATEGORY and
> VARS to send values into the jobs of the inner dags. The documentation
> mentions that MAXJOBS can be controlled this way so I'm hoping there is the
> same functionality for VARS.
>
> I'll potentially going to have a lot of jobs with slight variations and I'm
> trying to work around having to generate submit files for each.
>
> I've put together an example of what I'm wondering is possible:
>
>
> #BEGIN DAG FILE X.dag
>
> JOB A condor_job_A.submit
> CATEGORY A catA
>
> JOB B condor_job_B.submit
> CATEGORY B catB
>
> PARENT A CHILD B
>
> #END DAG FILE X.dag
>
> -----------------------------------------------
>
> #BEGIN DAG FILE S.dag
>
> JOB A outer_job_A.submit
> JOB B outer_job_B.submit
>
> SPLICE X1 X.dag
> VARS X1+catA myvar="myvalue1"
>
> SPLICE X2 X.dag
> VARS X2+catA myvar="myvalue2"
>
> SPLICE X3 X.dag
> VARS X3+catA myvar="myvalue3"
>
> PARENT A CHILD X1 X2 X3
> PARENT X1 X2 X3 CHILD B
>
> # END DAG FILE S.dag
>
>
> Cheers,
> Chris.