Re: [Condor-users] Multicollectors

[Dan Bradley <dan@xxxxxxxxxxxx>]

A multi-tier collector is particular important for large dynamic pools 
that operate over high-latency networks using strong authentication.  By 
high-latency I mean round trip times over 50 milliseconds.  By large 
dynamic pools, I mean pools such as those created by glideinWMS where 
nodes can come and go at rates of 10 per second or more.

In contrast to those conditions, you are unlikely to see much benefit 
from a multi-tier collector on a fast secure network with long-lived nodes.

--Dan

On 1/30/11 1:30 PM, Steven Timm wrote:
> That wiki page was written for GSI authentication which has become a
> lot more stable now with fewer memory leaks.  The most GSI slots I 
> have run in a single collector
> is about 16K. I think the production glideinWMS are doing more than
> that now but  I know at one point they used a tiered collector, not
> sure if they still do.
>
> As the wiki page hints, it is easy to get a static pool going that is 
> that
> big.  the load comes when you have a huge influx of slots into the pool
> or a huge drop of slots from the pool, or glidein slots that come and
> go all the time.
>
> Steve Timm
>
>
> On Sun, 30 Jan 2011, Rita wrote:
>
> > When does one have to worry about getting another collector?
> >
> > Also, is this still valid? I am hoping things have changed and 
> > collectors
> > have become more scalable.
> > https://condor-wiki.cs.wisc.edu/index.cgi/wiki?p=HowToConfigCollectors
> >
> > caio