Re: [Condor-users] Condor and Python

[22Nick22 Yanpei Liu <yliu73@xxxxxxxx>]

Hi:

Finally I identify the problem. The Python script I was trying to run requires an installed module built by me. However, without the permission I can't install the module onto the Unix server. I asked my advisor about this and he asked me to get some help from CAE. So I'm writing you this email see if, by any means, I could have some sort of permission to install my own module to carry out the simulation. 

I don't know if you are the correct person to ask though, sorry for bothering. 

Regards
Nick  

On 11/08/10, Nick LeRoy  <nleroy@xxxxxxxxxxx> wrote:

> > > I write a python script which takes too much time to run in my Mac... I
> > > therefore turn to Condor for help. I've learned the way to run Matlab
> > > script in Condor so I guess running Python should be similar.
> > 
> > It depends on how you plan to speed things up.
> > 
> > I assume the speed up with Matlab comes from a discretisation of
> > the computation and using the Matlab Compiler Runtime to process
> > those, then smaller run time, computational units in an embarassingly
> > parallel batch fashion.
> > 
> > You can do the same for the "loops" in your python scripts and just
> > submit them into your Condor pool as you would any other script,
> > assuming python is somewhere on the path available for you on the
> > resources uderlying your Condor pool.
> > 
> > I guess you could compile the python too, should it not be on the
> > remote boxes, thereby paralleling the Matlab use case even further.
> > I am less familiar with the supporting environment needed for the
> > running of compiled python though.
> > 
> > If, however, your Matlab speed up comes from utilising one their
> > parallel toolboxes, you'll need to find similar packages for your
> > python environment which would then require some tailoring of the
> > underlying Condor "universe" too, to do the explicit, message passing,
> > parallelisation.
> 
> I recently learned of matplotlib (http://matplotlib.sourceforge.net/) which is 
> a Python library that provides much of Matlab's functionality in a Python 
> programming environment.
> 
> -Nick
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> 
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
-- 
---------------------------------------------------
"Nick" Yanpei Liu
Ph.D Student
Electrical & Computer Engineering
University of Wisconsin - Madison

http://homepages.cae.wisc.edu/~yanpei/
---------------------------------------------------