[Building Sakai] 2.9.1 Performance Issues

Wed Jul 24 09:30:13 PDT 2013

Matt Jones pointed out that my components.xml wasn't using Sakai's default
cache properties, so I updated it to use
"org.sakaiproject.memory.util.EhCacheFactoryBean" instead of
"org.springframework.cache.ehcache.EhCacheFactoryBean".  The big issue
would be with the change of the default overflowtodisk property.  It should
be set to false (even though ehcache's default is true now).

I'm still interested in how you're using Delegated Access, since this still
seems like a lot of data to be setup in the cache (i.e. usage)

-Bryan

On Wed, Jul 24, 2013 at 12:01 PM, Bryan Holladay <holladay at longsight.com>wrote:

> The cache you are mentioning would be hard to take up that much memory,
> especially with the default settings of 10k items.  For example,
> restrictedAuthToolsCache is a map of userId->siteId->restrictedTools for
> only delegated access admin users.  99% of the time, the list of restricted
> tools will be an empty list unless you have manually went into the user's
> permissions and checked off a list of tools that are restricted, then its
> just that list.  Also, this list is only populated whenever a user tries to
> access the site, otherwise, it isn't in the cache.
>
> Are you doing something special with Delegated Access?  Also, could you
> send the dump of your Administration Workspace->Memory information?  Maybe
> there's something in there that can help.
>
> -Bryan
>
>
>
>
> On Wed, Jul 24, 2013 at 11:25 AM, Curtis Van-Osch <curtis.van-osch at hec.ca>wrote:
>
>>  Thanks Sam and David,
>> I've integrated those patches, but upon inspecting a heap dump in Eclipse
>> MAT, it looks like our Delegated Access cache is filling the memory!
>>
>> I've opened an issue in jira here:
>> https://jira.sakaiproject.org/browse/DAC-56
>>
>> I'm hoping it's just a question of setting better ehcache settings...
>>
>> Curtis
>>
>> -------- Message original --------
>> Sujet: Re: [Building Sakai] 2.9.1 Performance Issues
>> De : David Horwitz <david.horwitz at uct.ac.za> <david.horwitz at uct.ac.za>
>> Pour : Sam Ottenhoff <ottenhoff at longsight.com> <ottenhoff at longsight.com>
>> Copie à : Curtis Van-Osch <curtis.van-osch at hec.ca><curtis.van-osch at hec.ca>,
>> sakai-dev Developers <sakai-dev at collab.sakaiproject.org><sakai-dev at collab.sakaiproject.org>
>> Date : 2013-07-24 04:54
>>
>> You might want to look at this fix too:
>>
>> https://jira.sakaiproject.org/browse/SAK-23524 (Roster)
>>
>> its a similar pattern to the GB one bellow and caused us some pain.
>>
>> D
>>
>> On Tue, 2013-07-23 at 16:56 -0400, Sam Ottenhoff wrote:
>>
>> I haven't observed any issues that would explain gigantic memory usage
>> CPU spiked at 100%.  I would try to get a heap dump into Eclipse MAT as
>> soon as possible.
>>
>>
>>
>>  --Sam
>>
>>
>>
>>  On Tue, Jul 23, 2013 at 4:53 PM, Curtis Van-Osch <curtis.van-osch at hec.ca>
>> wrote:
>>
>>  Hello,
>> We at HEC Montréal recently upgraded to Sakai 2.9.1 (last monday).
>> Everything went well, but we have been experiencing performance issues ever
>> since.  Memory usage hovers between 6.5 and 8 gigabytes, and CPU usage
>> often spikes to 100%
>>
>> our JAVA_OPTS="-d64 -server -Xmx10g -Djava.awt.headless=true -Xms512m
>> -XX:MaxPermSize=768m -XX:PermSize=256m -Duser.language=fr -Duser.region=CA"
>>
>> We're planning on inspecting a heap dump tomorrow morning, and we're
>> looking at applying this Gradebook patch<https://jira.sakaiproject.org/browse/SAK-23385>(SAK-23385).
>>
>> Does anyone have any other ideas for diagnosing performance issues?
>>
>>  --
>>   <http://www.hec.ca>
>>
>>  Curtis Van Osch Analyste-Programmeur Direction des technologies de
>> l'information  [image: hec.ca] <http://www.hec.ca>  [image: Agréments] 3000, chemin de la Côte-Sainte-Catherine,
>> Montréal (Québec) H3T 2A7 Téléphone : 514 340-6000, poste 2029
>>
>>    [image: recyclez]   Pensons à l'environnement avant d'imprimer
>>
>>
>> _______________________________________________
>> sakai-dev mailing list
>> sakai-dev at collab.sakaiproject.org
>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>
>> TO UNSUBSCRIBE: send email to
>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of
>> "unsubscribe"
>>
>>
>>
>>  _______________________________________________
>> sakai-dev mailing listsakai-dev at collab.sakaiproject.orghttp://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>
>> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
>>
>>
>> ------------------------------
>> UNIVERSITY OF CAPE TOWN
>>
>> This e-mail is subject to the UCT ICT policies and e-mail disclaimer
>> published on our website at
>> http://www.uct.ac.za/about/policies/emaildisclaimer/ or obtainable from
>> +27 21 650 9111. This e-mail is intended only for the person(s) to whom it
>> is addressed. If the e-mail has reached you in error, please notify the
>> author. If you are not the intended recipient of the e-mail you may not
>> use, disclose, copy, redirect or print the content. If this e-mail is not
>> related to the business of UCT it is sent by the sender in the sender's
>> individual capacity.
>>
>>
>>
>> --
>>    <http://www.hec.ca>
>>  Curtis Van Osch
>> Analyste-Programmeur
>> Direction des technologies de l'information
>>   [image: hec.ca] <http://www.hec.ca>   [image: Agréments]
>> 3000, chemin de la Côte-Sainte-Catherine, Montréal (Québec) H3T 2A7
>> Téléphone : 514 340-6000, poste 2029
>>
>>    [image: recyclez]
>> Pensons à l'environnement
>> avant d'imprimer
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 345 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4883 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0001.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4883 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0002.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 20493 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment.jpe 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 5127 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0003.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 345 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0004.png 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 20493 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0001.jpe 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 5127 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/69793230/attachment-0005.png 