Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] lightweight cluster/grid engine
- Date: Tue, 24 May 2011 04:08:01 +1000
- From: Tim Kremer <tim@xxxxxxxxxxxxxx>
- Subject: Re: [Condor-users] lightweight cluster/grid engine
Hi Erik,
I've had success launching jobs from within a job using condor's web services (soap) interface.
Since i prefer SOA architectures, i do most integration with condor via soap where possible (admittedly the soap interface has limitations)
Hope that helps.
Tim
Sent from my iPhone
On 19/05/2011, at 8:30 AM, Erik Aronesty <erik@xxxxxxx> wrote:
> Yes. I've had some trouble having a job launch anoher job using
> condor_submit with the queue. ( This among other things. )
>
> I'm a good programmer, a barely passing system admin. The time I put
> in figuring out condor was greater than the time I'd figure I'd put in
> writing my own a queue manager. Now that it's in place, I need condor
> only for mpi/java universe stuff and off-grid things. I still use
> condor, and probably will for a while.
>
> I also wrote "gwrap" .. which can be used with any cluster solution
> (condor, grun, torque). It downloads all the dependencies for a job
> from a server... without having to specify the dependencies in the job
> file. It can also record all the files created, and push them back to
> the origin server when the program is finished. Again, no need to
> specify stuff... everything is detected based on system calls.
>
> - Erik
>
> On Wed, May 18, 2011 at 5:25 PM, Alan De Smet <adesmet@xxxxxxxxxxx> wrote:
>> Erik Aronesty <erik@xxxxxxx> wrote:
>>> I wrote a very lightweight cluster/grid engine for dedicated networks,
>>> mostly because condor didn't allow me to "subqueue" other jobs,
>>
>> What's the "subqueue" support that you're finding Condor doesn't
>> support? You talking about having a running job itself invoke
>> grun, either in the blocking or non-blocking (-nowait) modes?
>>
>> --
>> Alan De Smet Condor Project Research
>> adesmet@xxxxxxxxxxx http://www.cs.wisc.edu/condor/
>> _______________________________________________
>> Condor-users mailing list
>> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
>> subject: Unsubscribe
>> You can also unsubscribe by visiting
>> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>>
>> The archives can be found at:
>> https://lists.cs.wisc.edu/archive/condor-users/
>>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/