Re: [HTCondor-users] PROBLEM Submitting CONDOR JOB WITH BASH SCRIPT

[John M Knoeller <johnkn@xxxxxxxxxxx>]

did the job go on hold?

was there an error message in the .log file?

was there anything in the .log file?

 

There is no statement in your submit file telling it to transfer the shower_test.sh file.  This is ok if you have a shared file system

between the submit machine and execute machine, but not if you donât.   Missing statements about file transfer may also be why

you arenât getting any output files â because you havenât told condor to transfer them back.

 

try adding

 

should_transfer_files = yes

transfer_input_files = $(script_to_run)

when_to_transfer_output = ON_EXIT

 

to your submit file.

-tj

From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of MICHELE GROSSI
Sent: Monday, January 8, 2018 11:13 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: Re: [HTCondor-users] PROBLEM Submitting CONDOR JOB WITH BASH SCRIPT

 

Sorry for being misleading.

I mean that the submission works bit the job run is short and in fact I got no output. It seems that the bash script inside did not start.

MG

saluti,
Michele

 

Il 08 gen 2018 6:04 PM, "John M Knoeller" <johnkn@xxxxxxxxxxx> ha scritto:

We donât understand what you mean when you say âSUBMISSION WORKS BUT IT DOES NOT WORKâ

 

you need to be more specific.  

 

Does condor_submit succeed or fail?

If it fails, what is the error message

If it succeeds, what is it that is failing?

 

-tj

 

From: HTCondor-users [mailto:htcondor-users-bounces@xxxxxxxxxxx] On Behalf Of MICHELE GROSSI
Sent: Friday, January 5, 2018 4:02 PM
To: htcondor-users@xxxxxxxxxxx
Subject: [HTCondor-users] PROBLEM Submitting CONDOR JOB WITH BASH SCRIPT

 

Hello, I would ask your help in understanding how to submit a job to condor like what I'm trying to explain.

FIRST PART

I have a bash script (for sake of simplicity I removed my internal path folder and I used a fancy one, consider that the shell script and the program works fine local) that using shell command, loop through a folder and extract some files parsing the name. Once scouting the name I need, I use that to execute another program.
Then I need to execute a program (SECOND PART) that can be run in terminal typing the row you see starting with ./

#!/bin/bash

cp -r /myfolder/lastfolder .
cd last folder
source config.sh

for i in $( ls /myfolder/lastfolder/gen*$1/data.dat ); do
gen=$(echo $i)
percorso=`echo $gen | cut -d'/' -f9- `
singlegen_old=`echo $gen | cut -d'/' -f9-| sed -e 's/\/data.dat//g' `
singlegen=`echo $percorso | sed -e 's/\/data.dat//g' `
number=`echo $singlegen | sed -e 's/gen//g' `

./main.exe firstargument.cmnd $i thirdargument_$number.dat

done

The submit condor is the following:

# begin Condor submit file
# actual job is performed by the shell script

script_to_run = shower_test.sh
Arguments = $(script_to_run)
Executable = /bin/bash
Output = $(script_to_run).$(cluster).$(process).out
Error = $(script_to_run).$(cluster).$(process).err
Log = $(script_to_run).log
Queue 1
# end Condor submit file

The CONDOR SUBMISSION WORKS BUT IT DOES NOT WORK.

THANK YOU

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/