Mailing List Archives
Authenticated access
|
|
|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Condor-users] memory leak in Condor 7.4.2 schedd ???
- Date: Thu, 17 Jun 2010 11:23:11 +0100
- From: "Smith, Ian" <I.C.Smith@xxxxxxxxxxxxxxx>
- Subject: Re: [Condor-users] memory leak in Condor 7.4.2 schedd ???
I think the 900 MB memory footprint may have been a one off
caused by a user (funny how things work so much better
without them ;-)).
Currently I have just one job in the queue and the schedd is using
~ 13 MB so it looks like memory is getting released properly at least
most of the time.
What's worrying me now is that the collector is taking ~ 400 MB.
We're using power management here and I automatically publish/update
ClassAds for offline jobs frequently (every 15 min) so could this be putting a
strain on it ?
I'm running the central manager/submit host on a Sun SMP so there's
bags of real memory to play with (16 GB) but these large memory
footprints surely don't do much for cache re-use ???
regards,
-ian.
> -----Original Message-----
> From: condor-users-bounces@xxxxxxxxxxx [mailto:condor-users-
> bounces@xxxxxxxxxxx] On Behalf Of Matthew Farrellee
> Sent: 15 June 2010 20:39
> To: Condor-Users Mail List
> Subject: Re: [Condor-users] memory leak in Condor 7.4.2 schedd ???
>
> Dan Bradley wrote:
> >
> >
> > Matthew Farrellee wrote:
> >>
> >>
> >> FYI, Condor uses string interning to minimize the memory footprint of
> >> jobs (all classads actually), but, iirc, does not always garbage
> >> collect the string pool. If you have a lot of jobs passing through
> >> your Schedd, say with large unique Environments, you could certainly
> >> see memory usage increase.
> >
> > Actually, the ClassAd string pool is garbage collected via reference
> > counting. I'm not aware of any case where this string pool gets bloated
> > from jobs that are no longer in the job queue.
> >
> > --Dan
>
> This was supposed to be the case. I see a number of related commits from
> a year ago (by me!). Recollection is reference counting wasn't happening
> properly. Maybe I didn't fully fix it.
>
> Best,
>
>
> matt
> _______________________________________________
> Condor-users mailing list
> To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/condor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/condor-users/