Re: [Condor-users] Problems with jobs

["Chris Miles" <chrismiles@xxxxxxxxxxxxxxxx>]

While I apreciate running one job on one node may take longer because of
overheads, I would think that when submitting 50 jobs simultaneously,
the overhead time will be at the same time also therefor giving me an over
all speed increase still because I would still not have had time to run 
those
50 jobs individually.

Might it be possible to have my condor job do more than 1 of my jobs?

At the moment I use the same executable and the same dataset on every job
that runs but the application does slightly different work with slightly 
different
results, and then prints the output to the console.

Might it make a difference for example..

I dont want to change my main console application code but I could write 
another
small front end program as the main executable which will then fire my job.

for example

1. submission file specifies executable = frontend, and transfers 
console_som and
dataset as required files.

2. submission file specifies the process id as an argument to the front end

3. on the condor node frontend runs 100 times piping the results from 
console_som into an output file

4. returns 100 output files back to me (from each machine)

better idea?

Chris
----- Original Message ----- 
From: "Matt Hope" <matthew.hope@xxxxxxxxx>
To: "Condor-Users Mail List" <condor-users@xxxxxxxxxxx>
Sent: Thursday, December 08, 2005 6:39 PM
Subject: Re: [Condor-users] Problems with jobs


> On 12/8/05, Chris Miles <chrismiles@xxxxxxxxxxxxxxxx> wrote:
> > Im using my real jobs just now. They are fairly quick.. especially on the
> > cluster
> > machines as they are very powerfull. Im planning on running a lot 
> > though...
> > like
> > upto 10 thousand and more.
>
> If condor with GCB loses the claim after every job then you have a
> real problem with using this for high throughput.
>
> don't know if this will help
>
> http://www.cs.technion.ac.il/Labs/dsl/completed_projects/condor-llic/llic_web_site.htm
>
> > Ive been working on this project for the best part of 2 years now on and
> > off..
> > I cant give up on the condor side of it now :)
>
> if a tool won't do what you want it to change the tool or use a different 
> one...
>
> > Im willing to jump through any hoops to get it working. Ive been through
> > many
> > since i started anyway haha.
>
> think you need to take a look at what your overall plan is here
>
> Matt
>
> _______________________________________________
> Condor-users mailing list
> Condor-users@xxxxxxxxxxx
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users