Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [HTCondor-users] dagman api
- Date: Fri, 25 Oct 2013 11:07:10 -0500 (CDT)
- From: "R. Kent Wenger" <wenger@xxxxxxxxxxx>
- Subject: Re: [HTCondor-users] dagman api
On Fri, 25 Oct 2013, Keith Brown wrote:
I suppose my intention was to build a Python API for it but it seems if I
call subprocess in python to condor_dag_man, I think that should be
sufficient.
Below is an HTCondor submit file generated by condor_submit_dag. Note
that if you spawn condor_dagman as a process, you'll have to pass most of
the arguments below or condor_dagman won't run.
Also, you *must* have _CONDOR_DAGMAN_LOG set in the environment or
condor_dagman won't run. I'm not sure if you absolutely need the other
environment variables.
Kent
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# Filename: job_dagman_basic.dag.condor.sub
# Generated by condor_submit_dag job_dagman_basic.dag
universe = scheduler
executable = /scratch/wenger/condor_build/git5/personal_condor/release_dir/bin/condor_dagman
getenv = True
output = job_dagman_basic.dag.lib.out
error = job_dagman_basic.dag.lib.err
log = job_dagman_basic.dag.dagman.log
remove_kill_sig = SIGUSR1
+OtherJobRemoveRequirements = "DAGManJobId == $(cluster)"
# Note: default on_exit_remove expression:
# ( ExitSignal =?= 11 || (ExitCode =!= UNDEFINED && ExitCode >=0 && ExitCode <= 2))
# attempts to ensure that DAGMan is automatically
# requeued by the schedd if it exits abnormally or
# is killed (e.g., during a reboot).
on_exit_remove = ( ExitSignal =?= 11 || (ExitCode =!= UNDEFINED && ExitCode >=0 && ExitCode <= 2))
copy_to_spool = False
arguments = "-f -l . -Lockfile job_dagman_basic.dag.lock -AutoRescue 1 -DoRescueFrom 0 -Dag job_dagman_basic.dag -Suppress_notification -CsdVersion $CondorVersion:' '8.1.2' 'Oct' '07' '2013' 'BuildID:' 'UW_development' 'PRE-RELEASE-UWCS' '$ -Verbose -Force -Notification never -Dagman /scratch/wenger/condor_build/git5/personal_condor/release_dir/bin/condor_dagman"
environment = _CONDOR_DAGMAN_LOG=job_dagman_basic.dag.dagman.out;_CONDOR_SCHEDD_ADDRESS_FILE=/scratch/wenger/condor_build/git5/personal_condor/spool/.schedd_address;_CONDOR_SCHEDD_DAEMON_AD_FILE=/scratch/wenger/condor_build/git5/personal_condor/spool/.schedd_classad;_CONDOR_MAX_DAGMAN_LOG=0
notification = never
queue