Re: [HTCondor-users] event log type 28 messages as supplement to each default message?

[Cole Bollig <cabollig@xxxxxxxx>]

Hi Thomas,

Event log number 28 event writes the pertinent information from the job ad used for the logging of the event in the labeled TriggerEventTypeNumber/Name. All job ad attributes found in the EVENT_LOG_JOB_AD_INFORMATION_ATTRS config knob will be added to that list of information and logged as key = value pairs of information. Event 28 only gets logged if the above config knob is set.

Hope this helps,

Cole Bollig

---

From: HTCondor-users <htcondor-users-bounces@xxxxxxxxxxx> on behalf of Thomas Hartmann <thomas.hartmann@xxxxxxx>
Sent: Thursday, March 2, 2023 7:16 AM
To: HTCondor-Users Mail List <htcondor-users@xxxxxxxxxxx>
Subject: [HTCondor-users] event log type 28 messages as supplement to each default message?

 

Hi all,

just a quick question to confirm my interpretation of event log #28
messages: each 'ordinary' event has its #28 event, that is enhanced by
all the ads defined with EVENT_LOG_JOB_AD_INFORMATION_ATTRS, or? And
there are no non-28 events without an addon #28 event (and vice versa).

E.g., the job size update [1] add on event is [2] containing all the
base information plus the extra ads.

Background: we have been thinking about slimming down the event stream
and discarding all non-28 events keeping only #28 events and further
selecting on TriggerEventTypeNumber.

Cheers,
   Thomas


[1]
{
   "ResidentSetSize": 1353560,
   "Size": 16014204,
   "MemoryUsage": 1322,
   "Proc": 2771,
   "Cluster": 37364222,
   "EventTime": "2023-03-02T13:35:44.823",
   "MyType": "JobImageSizeEvent",
   "Subproc": 0,
   "EventTypeNumber": 6
}

[2]
{
   "RequestCpus": 1,
   "TriggerEventTypeNumber": 6,
   "User": "sdreyer@xxxxxxx",
   "ProcId": 2771,
   "MemoryUsage": 1322,
   "RemoteWallClockTime": 0.0,
   "RemoteUserCpu": 497.0,
   "DESYAcctGroup": "BIRD_belle",
   "JobCurrentStartExecutingDate": 1677760111,
   "Size": 16014204,
   "Cluster": 37364222,
   "Proc": 2771,
   "EventTime": "2023-03-02T13:35:44.823",
   "TriggerEventTypeName": "ULOG_IMAGE_SIZE",
   "MyType": "JobAdInformationEvent",
   "GlobalJobId": "bird-htc-sched14.desy.de#37364222.2771#1677759490",
   "CpusProvisioned": 1,
   "Subproc": 0,
   "ResidentSetSize": 1353560,
   "Project": "af-belle2",
   "Owner": "sdreyer",
   "EventTypeNumber": 28,
   "RemoteSysCpu": 23.0,
   "ClusterId": 37364222,
   "RequestDisk": 20480000,
   "RequestMemory": 1536,
   "CPUsUsage": 0.9580782474157068,
   "SysProject": "af-belle2",
   "DiskProvisioned": 22403930,
   "DiskUsage": 1
}