[HTCondor-users] Concatenating history files?

["Pelletier, Michael V RTX" <Michael.V.Pelletier@xxxxxxx>]

Hi folks,

 

I’ve got a huge amount of job history I’m trying to go through and summarize/categorize, to the tune of many gigabytes, and as you might expect it’s divided into a collection of rotated files with the usual timestamps.

 

I’m trying to use the -file option, so that it doesn’t bother the server and suffer the constraints of network connection and can work directly from a local filesystem where I’ve stashed the files.

 

Is there a way to enable condor_history to scan all the files in one fell swoop, rather than going through them one at a time with separate condor_history -file commands? I tried concatenating the files but it looks like the last line in each file has some metadata that condor_history pays attention to.

 

Thanks for any suggestions!

 

Michael V Pelletier

Principal Technologist

High Performance Computing

Classified Infrastructure Services