Re: [Condor-users] retrieving output subdirectories

[Mark Calleja <M.Calleja@xxxxxxxxxxxxxxx>]

Hi Ian,

Ian Stokes-Rees wrote:
> And a related question: is there any way to view output files for jobs 
> that are in the process of executing?

Do you mean for the vanilla universe? In that case some of us have 
rolled our own solutions, e.g. this is how we do it:

http://www.escience.cam.ac.uk/projects/camgrid/file-viewer.html

There are other ways too. At last November's HTC workshop in Edinburgh, 
Miron mentioned somebody else's solution that had a process that got 
submitted with a job that could be interrogated on the fly, but I'm not 
aware of any documentation. Miron, have you got any more details of this 
method?

On a broader scope, are there any other solutions out there that people 
would like to mention? I'm very interested in this subject and would 
love to hear of other approaches.

Cheers,
Mark

--
Cambridge eScience Centre, University of Cambridge
Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA
Tel. (+44/0) 1223 765317, Fax  (+44/0) 1223 765900
http://www.escience.cam.ac.uk/~mcal00


> Cheers,
>
> Ian
>
> carl langlois wrote:
> > Hi Javier,
> >
> >   I have the same problem as you, what i'm planning to do is wrap the 
> > application in a .bat file or .sh if on unix and after the jobs is 
> > complete juste zip everything and tell condor to retrived the zip file.
> >
> >
> > On Feb 4, 2008 5:37 AM, Javier Forment <jforment@xxxxxxxxxxxx 
> > <mailto:jforment@xxxxxxxxxxxx>> wrote:
> >
> >     Hi, all... I'm trying to run an application in Condor which
> >     creates an
> >     output subdirectory and write output files on it. I know that
> >     Condor has
> >     the feature of retrieving (and sending back to submit node) only the
> >     output files created/modified in the plain execute directory at the
> >     corresponding execute node.
> >
> >     Is there any way to cope with this? I've browsed the archives at the
> >     mailing list, but I only find messages telling that it is a
> >     well-known
> >     issue, and the solution is to modify the application or writing a
> >     custom
> >     wrapper for condor to tar (and maybe gzip) the output
> >     subdirectory/ies.
> >
> >     Since I cannot modify the application, where can I find
> >     documentation to
> >     write such a custrom wrapper for condor?
> >
> >     Thanks a lot,
> >
> >     Javier.
> >
> >
> >     _______________________________________________
> >     Condor-users mailing list
> >     To unsubscribe, send a message to
> >     condor-users-request@xxxxxxxxxxx
> >     <mailto:condor-users-request@xxxxxxxxxxx> with a
> >     subject: Unsubscribe
> >     You can also unsubscribe by visiting
> >     https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >
> >     The archives can be found at:
> >     https://lists.cs.wisc.edu/archive/condor-users/
> >
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > Condor-users mailing list
> > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >
> > The archives can be found at: 
> > https://lists.cs.wisc.edu/archive/condor-users/
> >   
>
> --
> Ian Stokes-Rees                            W: http://sbgrid.org
> ijstokes@xxxxxxxxxxxxxxxxxxx               T: +1 617 418-4168
> SBGrid, Harvard Medical School             F: +1 617 432-5600
>
>   
> ------------------------------------------------------------------------
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at: 
> https://lists.cs.wisc.edu/archive/condor-users/
>