Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] retrieving output subdirectories
Hi,
This has been a very interesting thread but assumes Linux execute
computers. Has anyone done similar work in the Windows space?
Regards
Robin
-----Original Message-----
From: condor-users-bounces@xxxxxxxxxxx
[mailto:condor-users-bounces@xxxxxxxxxxx] On Behalf Of Javier Forment
Sent: Tuesday, 5 February 2008 6:05 a.m.
To: Condor-Users Mail List
Subject: Re: [Condor-users] retrieving output subdirectories
Great... Thanks to everybody... I will try it...
On Mon, 2008-02-04 at 11:24 -0500, Ian Chesal wrote:
> > If I put the tarring of subdirectory output files just after
> condor_submit in
> > a shell script, it will not find them, will it?
>
> Correct. You need to, as part of the command you told Condor to
execute,
> bundle up the output for return. So if you were telling condor to run
> 'myapp', now you're going to write a script, lets call it
myscript.bash,
> that is:
>
> #!/usr/bin/env bash
> maypp
> tar cvfz myapp.tar.gz `find . -newer time_stamp_file`
>
> and tell Condor to run myscript.bash instead of myapp.
>
> (I have to say I'm not 100% certain that second line will work. Bash
> scripting isn't something I do all that often.)
>
> > How must I tar all the output files (including the subdirectories)
> just
> > after process completion, but just before moving the output files
and
> > removing the execute directory?
>
> Instead of removing everything from the output directory except the
> tarball you can tell Condor what files to return. In this case you'd
> tell it to ignore everything except for the stderr, stdout and your
> mayapp.tar.gz file. See:
>
> http://www.cs.wisc.edu/condor/manual/v6.8/condor_submit.html
>
> Seach for 'transfer_output_files' on that page to see how you tell
> Condor *which* files you want it to return.
>
> - Ian
>
>
> Confidentiality Notice. This message may contain information that is
confidential or otherwise protected from disclosure.
> If you are not the intended recipient, you are hereby notified that
any use, disclosure, dissemination, distribution,
> or copying of this message, or any attachments, is strictly
prohibited. If you have received this message in error,
> please advise the sender by reply e-mail, and delete the message and
any attachments. Thank you.
>
>
>
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx
with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users
The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/