Re: [Condor-users] Monitoring remote job progress

[Javier Forment Millet <jforment@xxxxxxxxxxxx>]

This works fine, but not completely: when I do that, I effectively can monitor
the progress of the process because the file indicated in the 'output'
parameter at the process configuration file is created and filled at the submit
node and not in the execution node. But there is some strange behaviour because
it consistently ends incomplete: the condor process apparently ends fine
(nothing at condor_q, 'Normal termination (return value 0)'at log file,...),
but the output file is incomplete, and the temporary directory at execution
node (inside /home/condor/execute/) is not removed.

Any idea?



Quoting Ben Burnett <burnett@xxxxxxxxxxx>:

> Hi Javier:
>
> If you want to monitor the jobs from the submit machine, then you could try
> setting stream_output/_error to true.  This would allow you to check the
> progress on the execute side by looking at the local output/error files.
>
> Regards,
> -B
>
> > -----Original Message-----
> > From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-
> > bounces@xxxxxxxxxxx] On Behalf Of Javier Forment Millet
> > Sent: Tuesday, June 17, 2008 4:25 AM
> > To: Condor-Users Mail List
> > Subject: [Condor-users] Monitoring remote job progress
> >
> > Hi, all...
> >
> > I'm running long-time processes in a Condor cluster. These processes
> > write
> > output files which can be inspected to estimate the final total
> > execution time
> > of the process.
> >
> > Is there any way to see these files before the end of the process
> > without
> > logging to the execution nodes? (something like a Condor variable in
> > the
> > process configuration file requesting the transfer of yet incomplete
> > output
> > files).
> >
> > Thanks in advance,
> >
> > Javier.
> >
> > --
> > Javier Forment Millet
> > Instituto de Biología Celular y Molecular de Plantas (IBMCP) CSIC-UPV
> >  Ciudad Politécnica de la Innovación (CPI) Edificio 8 E, Escalera 7
> > Puerta E
> >  Calle Ing. Fausto Elio s/n. 46022 Valencia, Spain
> > Tlf.:+34-96-3877858
> > FAX: +34-96-3877859
> > jforment@xxxxxxxxxxxx
> >
> > _______________________________________________
> > Condor-users mailing list
> > To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with
> > a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/condor-users
> >
> > The archives can be found at:
> > https://lists.cs.wisc.edu/archive/condor-users/
>
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/
>


-- 
Javier Forment Millet
Instituto de Biología Celular y Molecular de Plantas (IBMCP) CSIC-UPV
 Ciudad Politécnica de la Innovación (CPI) Edificio 8 E, Escalera 7 Puerta E
 Calle Ing. Fausto Elio s/n. 46022 Valencia, Spain
Tlf.:+34-96-3877858
FAX: +34-96-3877859
jforment@xxxxxxxxxxxx