Re: [HTCondor-users] condor_history query to collect all the jobs executed the day before

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

Hi Carles,

Just a quick thought:

Maybe it would be easier and less error-prone to use the "-since 
<jobid>" flag to condor_history than messing around with date ranges? 
If you can easily record the jobid of the last job fetched from the 
previous poll (day), I think it may work better for you.

regards,
Todd


On 5/22/2018 1:15 PM, Carles Acosta wrote:
> Dear all,
>
> We create log files to fill our accounting through condor_history 
> queries. Everyday we run a condor_history query to collect the jobs 
> finished the day before in a log file. At the beginning, we were using 
> CompletionDate as the endtime of the jobs to determine if the jobs 
> finish the day before, but we have observed that the jobs killed remain 
> with CompletionDate=0 and then, they were not considered. So, in the 
> past, we run something like this:
>
> /usr/bin/condor_history -const "CompletionDate >= $yesterday && 
> CompletionDate < $today" [...]
>
> where $yesterday is "date --date='00:00:00 yesterday' +%s" and today
> "date --date='00:00:00 today' +%s".
>
> However, we are interested to collect in our log files all the jobs 
> executed, it does not matter if they finished correctly or were killed. 
> Thus, we are now considering to use "JobStartDate+RemoteWallclockTime && 
> RemoteWallclockTime !=0" as condition, taking into account that all the 
> jobs with RemoteWallclockTime !=0 have to be accounted. What do you 
> think? Or there is a ClassAd attribute similar to CompletionDate that we 
> are missing to know the exact time a job ends (killed or not)?
>
> We are running HTCondor 8.6.10.
>
> Thank you in advance.
>
> Best regards,
>
> Carles
>
> --
> Carles Acosta i Silva
> PIC (Port d'Informacià CientÃfica)
> Campus UAB, Edifici D
> E-08193 Bellaterra, Barcelona
> Tel: +34 93 581 33 08
> Fax: +34 93 581 41 10
> http://www.pic.es
> AvÃs - Aviso - Legal Notice: http://www.ifae.es/legal.html
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685