Re: [HTCondor-users] exit hook not always report correct ImageSize

[JM <jm@xxxxxxxxxxxxxxxxxxxx>]

Matt,Â

Thanks for the reply.Â

Yes, I absolutely agree that python binding can be used to retrieve history data. However, I am curious if there is a trigger/hook that can be used to schedule the query of history data upon finishing a job. Is it right that condor history is the only place to capture memory usage (ImageSize/ResidentSetSize) of a job?Â

Looks like exit hook runs as a part of the job so the ImageSize and ResidentSetSize are not update at the beginning of execution of an exit hook. Is this right?

Thank you.

J.

On Thu, Jan 26, 2023 at 3:07 PM Matthew T West via HTCondor-users <htcondor-users@xxxxxxxxxxx> wrote:

Hi JM,

When it comes to parsing history logs, I would recommend the htcondor
python bindings. Here is the relevant tutorial from the docs
https://htcondor.readthedocs.io/en/latest/apis/python-bindings/tutorials/Advanced-Schedd-Interactions.html
Should have all the same functionality as condor_history, but you will
already be working with data objects.

Cheers,
Matt

On 26/01/2023 19:25, JM wrote:
> If there is a better way to collect condor history other than parsing
> condor_history log, it will be helpful too. The HTCondor is 9.12.0 on
> Ubuntu 20.

--
Matthew T. West
DevOps & HPC SysAdmin
University of Exeter, Research IT
www.exeter.ac.uk/research/researchcomputing/support/researchit
57 Laver Building, North Park Road, Exeter, EX4 4QE, United Kingdom

Please note, I may send emails out of 'normal' working hours, as this fits my own work-life balance. I do not expect a response outside of your own working hours.

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/