[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Scheduler agnostic API



Hi Tiago,

The closest thing I know of is DRMAA:

http://en.wikipedia.org/wiki/DRMAA

I don't think that ever was widely adopted; that said, HTCondor does provide a DRMAA C library.

Brian

On Jul 18, 2013, at 4:48 PM, Tiago Macarios <tiagomacarios@xxxxxxxxx> wrote:

Hi,

Does anybody knows of any scheduler agnostic API?

I would guess that most people (or a reasonable number) that use a scheduler system only want to have a certain program to process some data. So I was wondering, did anybody ever saw an API that "automagically" converts scheduler directives to a certain scheduler? I am fully aware that it is impossible to use all the functionality of all schedulers simply because they do not overlap.

But I guess that only a basic job could be easily "mapped" to different schedulers:
-> Condor
request_cpus = 1
request_memory = 100
Executable = someExecutable
arguments = someArgument
transfer_input_files = someInputFile
transfer_files = ON_EXIT

-> PBS, Torque
#PBS -l nodes=1:ppn=1,mem=100
someExecutable someArgument

(I guess PBS flavors would also need to bother with the shh copy side of things, but it seems doable)
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/