Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] Process list of files
- Date: Sat, 06 Dec 2014 11:27:42 -0600
- From: Dmitri Maziuk <dmaziuk@xxxxxxxxxxxxx>
- Subject: Re: [HTCondor-users] Process list of files
On 12/5/2014 7:52 PM, Roger Herikstad wrote:
...
for s in $( ls <some file pattern> ); do <some setup>; echo "cd
$PWD;
<some command with arguments> $s" | qsub <sge arguments>; done
I tend to submit these things as dags even if there's no parent-child
dependencies in there. Your shell one-liner then becomes 2 files: the
job submit file w/ "<some command> $(INFILE)" and the dag submit file w/
job my_1 <submit file>
vars my_1 INFILE="filename"
See condor_submit_dag in TFM.
Dima