[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Access to renamed DAG node names



On Mon, 12 Jan 2015, Brian Candler wrote:

Here's a rough idea of how I'm attempting to compose DAGs.

I want to write two similar dags using the same code; the output from one dag is used as the input to another; and the two dags are spliced into a parent dag.

Now, I tried doing this using a separate subdirectory for each dag, and using "SPLICE .... DIR=<directory>". However it doesn't do what I expected. Every submit file, every job output/error file still has to be explictly given relative to the top-level directory.

Could this perhaps be a bug? I'm using condor 8.2.4-281588

Hmm, I'll have to think about how this should actually work. The problem in this case is that making things work one way breaks them another way. But splices and sub-DAGs should probably work as similarly as possible, so maybe this could be considered a bug. I'm confident, though, that it's worked this way for a long time -- I guess it could be considered more of a design bug than an implementation bug.

If you use SUBDAG EXTERNALs instead of splices, though, things should work the way you want. (Is there any reason you really need to use splices rather than sub-DAGs?) (E.g., throttling?)

Kent