[prev in list] [next in list] [prev in thread] [next in thread] 

List:       shibboleth-users
Subject:    Re: [Shib-Users] Terracotta DGC
From:       Russell Beall <beall () usc ! edu>
Date:       2010-07-30 18:04:12
Message-ID: 8E8185E1-34BD-4179-98D6-7DBF4E2C2947 () usc ! edu
[Download RAW message or body]

You definitely have to run the DGC.  The best way is to run it by script at night.

If your passive server is busy syncing, then you have to wait for it to finish, but \
if you have to get up and running right away and you are close to the limit, a better \
way to refresh and get going again is to:

1.  shut everything down
2.  Delete:  $IDP_HOME/cluster/server/data   --  on all nodes
3.  Start services starting with the node you want to be active.
        The passive servers will all sync up right away since there is just a trivial \
amount of data to copy now. 4.  Set up the script to run on at least the active node. \
My script checks to see whether the node is active or not, so I run it on all nodes. \
5.  Check the TC server logs to make sure the script is running and successfully \
completing at night now.

If, on the other hand, you are not in production and are just running load tests or \
something, this just goes with the territory.  It is easy to outpace the garbage \
collection with a continuous stream of high load.

Regards,
Russ.

On Jul 30, 2010, at 8:05 AM, Roderick Grau wrote:

> Shib Users:
> 
> I am having an issue with my IDPs running out of space.  The culprit is
> Terracotta is not running its DGC.
> 
> The directory /usr/local/shib/cluster/server/data/objectdb keeps growing
> and there are files in there from when the instance was started.
> 
> I found a script to manually run the DGC:
> 
> https://spaces.internet2.edu/display/SHIB2/IdPClusterIssues
> 
> After some tweaking, I got it to run, but am getting this result:
> 
> 2010-07-30 11:03:43,547 ERROR - Cannot run DGC externally because PASSIVE
> server(s) are currently synching state with this ACTIVE server and DGC is
> disabled.
> 
> I have also found some java opts to add to the terracotta startup, but
> have not added them yet.
> 
> -verbose:gc \
> -XX:+PrintGCDetails \
> -XX:-TraceClassUnloading \
> -XX:MaxGCPauseMillis=5000 \
> -XX:+UseParallelOldGC \
> 
> Any one have any thoughts?
> 
> -Rod
> -- 
> Roderick Grau
> IT Systems Management Operations
> University at Albany
> 1400 Washington Avenue Ext
> Albany, New York 12222


[prev in list] [next in list] [prev in thread] [next in thread]