HTCondor Project List Archives



[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Condor-devel] Fwd: [condor-fw] new statistics effects on various ClassAds



On 09/16/2011 02:40 PM, John (TJ) Knoeller wrote:
FYI

-------- Original Message --------
Subject: 	[condor-fw] new statistics effects on various ClassAds
Date: 	Fri, 16 Sep 2011 13:20:29 -0500
From: 	John (TJ) Knoeller <johnkn@xxxxxxxxxxx>
To: 	Todd Tannenbaum <tannenba@xxxxxxxxxxx>
CC: 	Condor Flightworthy Team <condor-fw@xxxxxxxxxxx>



I did some measurements of how much various Ads increased as a result of
the new statistics

This table shows how many attributes were contained in each type of Ad
for v770
as well as how many more attributes are in v772 with statistics at level
1 (basic) and
at level 2 (verbose). the counts for verbose statistics include the
counts for basic.

Statistics are enabled at level 1 by default for all daemons Condor v772.

    Ad Type v770 v772 Level 1 v772 Level 2
    ----------- -------- ------------ -------------
    collector 88 114 (+26) 187 (+ 99)
    master 38 58 (+22) 139 (+103)
    negotiator 95 117 (+22) 190 (+ 95)
    scheduler 53 121 (+68) 265 (+212)
    slot(machine) 103 133 (+30) 259 (+143)
    submitter 48 67 (+22-3*) 207 (+162-3*)

Most of the increase at level 2 is from per-handler runtime statistics
in daemon core.

* the v770 submitter ad had HeldJobs, FlockedJobs and SubmitterTag these
attribs were not in 772..

-tj

The increase for slot is most concerning, then for master, maybe for submitter.

Will you provide a table with sizes (bytes)? Dan's work in the past suggested 2KB for slot ads, helpful in sizing CM nodes (how much memory do you buy?).

Best,


matt