Re: [Condor-users] Maya render farm with condor

[Dave STREET <davey_street@xxxxxxxxxxx>]

As I see it this is suybmitting a single job? so it wil only go to one node on the cluster.
 
I don't know what the excatuable is doing as I am no Maya expert.
 
But what you would expect to see iss something like
 
queue=50 
 
this would queue up 50 copies of the job each one would them be farmed out to an avalible node.
 
how you split the work between the clietns is up to you,
 
you may put a varibable in the comman line path, so that it takes the job number as an input.
 
you could set up mutiply input files that have the frames that you need to render (so have 50 inpu files each containing a segemtn of the entire job)
 
or you may even be able to set it up so that the jobs continue running and grab frames from a common source untill they have all be processed.
 
CONDOR will only farm out the jobs, it dosn't have any method to split up the aculy work load built in by default.
 
my sugestion would be to see how many fames you have in total. and the time it takes too render 1 frame.
 
then set up an input file that contains the file names of enough frames to keep a node busy for about 5min.
 
 
you would then set up your job.bat file to say some thing like
 
"for each file name in the input file run the maya command against."
 
and create say ten input files each with a differernt set of frame and give them a number. (start from zero)
 
ie input1.frames 
 
then the submit job would be
 
inputfile=input$(PROCESS).frames
 
queue=10
 
this would set up ten jobs and they will be farmed out to the nodes to run in parellal.
 
this woudl be the simple way to do it, I am sure there are better and more cleaver ways but this would be good to start of to see how it works.
 
Aaron
 

 

---

Date: Tue, 18 May 2010 18:02:10 +0530
From: ryan.virgo@xxxxxxxxx
To: condor-users@xxxxxxxxxxx
Subject: Re: [Condor-users] Maya render farm with condor


My submit file ...

universe = vanilla
requirements = Arch == "INTEL" && OpSYS == "WINNT51"
environment = PATH=C:\Program Files\Autodesk\Maya8.5\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;c:\condor\bin
executable = \\software-3\test\job.bat
TRANSFER_FILES  = ALWAYS
run_as_owner = TRUE
output = RenderThis.out
error = RenderThis.err
log = RenderThis.log
getenv = true
Queue

The exec bat file is

"c:\Program Files\Autodesk\Maya8.5\bin\Render.exe" -r mr -s 1 -e 5 -proj \\software-3\test -rd \\software-3\test\images \\software-3\test\scenes\myscene.mb



Ryan

On Tue, May 18, 2010 at 4:39 PM, Dave STREET <davey_street@xxxxxxxxxxx> wrote:

First post your submit config here
 
it sounds like each frame need to be a seperate job with in the submit file. 
 
post that so we can see what you are doing ?
 

---

Date: Tue, 18 May 2010 18:46:14 +0800
From: ijstokes@xxxxxxxxxxxxxxxxxxx
To: condor-users@xxxxxxxxxxx
Subject: Re: [Condor-users] Maya render farm with condor

On 5/18/10 6:14 PM, Ryan Braganza wrote:

Hi

I am trying to setup a maya render farm using condor. I submit a job to render 20 frames, the job executes on a single exec node,

But i wish that the job gets distributed and all exec nodes and each render 1 frame each, insated of the entire job just being handed over to a single exec node.

Can anyone help me out with this .?

I think this is really a question for someone with Maya exepertise.  Condor doesn't know anything specific about Maya.  Once you know what the Maya commands are render specific frames you can then setup a parameterized classad (or even DAG if appropriate) that will split up the commands into independent jobs that will be executed across your cluster.

Anyway, as I said, I think your question should be directed towards Maya documentation first (or Google), then Maya mailing lists second.  Once you have the commands you want, if you can't figure out how to get them split into separate Condor jobs, come back to this list.

Ian

---

Get a free e-mail account with Hotmail. Sign-up now.

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/

--
Ryan Braganza

---

Get a free e-mail account with Hotmail. Sign-up now.