[HTCondor-users] Weirdness with cputime, wall time and cpususage

[Jeff Templon <templon@xxxxxxxxx>]

Hi,

Looking at the docs, Iâd expect that (for single core jobs),

- cpu time will be less than wall time
- wall time * CpusUsage = cpu time

Some observations (using data from condor_history) after the job has completed, in some cases an hour or more ago:

- cpu time is missing (not always, but often)
- CpusUsage is more often than not slightly more than 1.00 (see attachment)

Is this a bug, or an unconventional definition of the various pieces, or some factor Iâve failed to account for?

Title: htcondor-cpususage

In [1]:

import htcondor
import classad

In [2]:

import time
now = time.mktime(time.localtime())

In [3]:

schedd = htcondor.Schedd()

shist=schedd.history( 
        constraint='CompletionDate > %d' % (now - 24*3600),
    projection=['ProcId', 'ClusterId', 'JobStatus', "AccountingGroup", "Owner", "CompletionDate", 'CpusProvisioned',
                'CpusUsage', 'JobCurrentStartDate'],
    match=2048,
)

In [4]:

import pandas as pd
import numpy as np
import matplotlib as plot

In [5]:

cpusul = list()
for ad in shist:
    if 'CpusUsage' in ad.keys():
        cpusul.append(ad['CpusUsage'])

In [6]:

c = pd.Series(cpusul)
c.hist(bins=64, range=(0.98, 1.02))

Out[6]:

<Axes: >

In [ ]: