Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] cluster number in shell script (sh)
- Date: Tue, 30 Nov 2010 15:00:09 +0200
- From: Alexandru Chiscan <lec@xxxxxxxxxxxxxxxxxxxx>
- Subject: Re: [Condor-users] cluster number in shell script (sh)
Hello Kevin,
I am not using the shell script in the condor job, but in order to
generate a cluster of condor jobs.
See my previous e-mail in response to Steve.
Alexandru
On 11/29/2010 06:55 PM, Roy, Kevin (LNG-SEA) wrote:
> I use environment variables. Here is an example using perl.
>
> My condor script
> executable = hostname.pl
> universe = globus
> grid_resource = gt2 hydrogen/jobmanager
> environment = CLUSTER=$(cluster);PROCESS=$(Process)
>
> output = hostname.out.$(cluster).$(Process)
> log = condorg.log.$(cluster).$(Process)
>
> should_transfer_files = YES
> when_to_transfer_output = ON_EXIT
>
> queue 3
>
> My perl script
> #!/usr/bin/perl -w
> use strict;
>
> open (FILE, `>hostname.out.$ENV{CLUSTER}.$ENV{PROCESS}`);
> open DATA, "hostname |" or die "Couldn't execute program: $!";
> while ( defined( my $line = <DATA> ) ) {
> chomp($line);
> print FILE "$line\n";
> }
> close FILE;
> close DATA;
>
> Kevin
> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx
> [mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Alexandru Chiscan
> Sent: Monday, November 29, 2010 1:32 AM
> To: Condor-Users Mail List
> Subject: [Condor-users] cluster number in shell script (sh)
>
>
> Hello all,
>
> I am using shell scripts to generate condor submit files and to submit
> them.
> The scripts generate clusters with many jobs (hundreds) and I want at
> the end to have in one log file the output and the error log of all the
> jobs in the cluster. For the moment I am using the shell name and pid
> for the log name ( $0.$$ ) but the pid will be reused and I will like to
> use the cluster number for it - which should be unique (or not?).
>
> Is there any way to get the cluster number in the script without having
> to parse the output of the condor_submit command?
>
> cluster=`condor_submit job.submit | grep "submitted to cluster" | awk
> '{print $6} `
> echo "cluster $cluster"
>
> Regards,
> Alexandru
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
> a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
>