[Building Sakai] 2.9.1 Performance Issues
Curtis Van-Osch
curtis.van-osch at hec.ca
Wed Jul 24 11:50:02 PDT 2013
We do indeed have something of a special use of Delegated Access that
could be causing these issues. We have our own internal tool that sort
of mimics Site Setup, allowing the secretaries of our different
departments to search for and access the sites associated to their
department without being participants in every site (we call it
OpenSyllabus Manager).
The algorithm for this search is
1. retrieve a list of course sites that match the given search string
(from SiteService.getSites)
2. for each site, if the current user is a participant, add it to the
list of search results
3. update the delegated access map for the current user
* get the "delegatedaccess.accessmap" from the SessionManager
* for each site, if it is not already in the map, post a new event
to the EventTrackingService (type "dac.checkaccess") specifying
the site reference.
4. for each site in the list from SiteService, if the delegated access
map contains the site reference, add it to the list of search results
This hasn't changed during our upgrade from Sakai 2.8.1/Delegated Access
1.0 to Sakai 2.9.1/Delegated Access 3.0 and we never had an issue before
so I assume the caching in Delegated Access has.
Curtis.
-------- Message original --------
Sujet: Re: [Building Sakai] 2.9.1 Performance Issues
De : Bryan Holladay <holladay at longsight.com>
Pour : Curtis Van-Osch <curtis.van-osch at hec.ca>
Copie à : David Horwitz <david.horwitz at uct.ac.za>, Sam Ottenhoff
<ottenhoff at longsight.com>, sakai-dev Developers
<sakai-dev at collab.sakaiproject.org>
Date : 2013-07-24 12:30
> Matt Jones pointed out that my components.xml wasn't using Sakai's
> default cache properties, so I updated it to use
> "org.sakaiproject.memory.util.EhCacheFactoryBean" instead of
> "org.springframework.cache.ehcache.EhCacheFactoryBean". The big issue
> would be with the change of the default overflowtodisk property. It
> should be set to false (even though ehcache's default is true now).
>
> I'm still interested in how you're using Delegated Access, since this
> still seems like a lot of data to be setup in the cache (i.e. usage)
>
> -Bryan
>
>
>
> On Wed, Jul 24, 2013 at 12:01 PM, Bryan Holladay
> <holladay at longsight.com <mailto:holladay at longsight.com>> wrote:
>
> The cache you are mentioning would be hard to take up that much
> memory, especially with the default settings of 10k items. For
> example, restrictedAuthToolsCache is a map of
> userId->siteId->restrictedTools for only delegated access admin
> users. 99% of the time, the list of restricted tools will be an
> empty list unless you have manually went into the user's
> permissions and checked off a list of tools that are restricted,
> then its just that list. Also, this list is only populated
> whenever a user tries to access the site, otherwise, it isn't in
> the cache.
>
> Are you doing something special with Delegated Access? Also,
> could you send the dump of your Administration Workspace->Memory
> information? Maybe there's something in there that can help.
>
> -Bryan
>
>
>
>
> On Wed, Jul 24, 2013 at 11:25 AM, Curtis Van-Osch
> <curtis.van-osch at hec.ca <mailto:curtis.van-osch at hec.ca>> wrote:
>
> Thanks Sam and David,
> I've integrated those patches, but upon inspecting a heap dump
> in Eclipse MAT, it looks like our Delegated Access cache is
> filling the memory!
>
> I've opened an issue in jira here:
> https://jira.sakaiproject.org/browse/DAC-56
>
> I'm hoping it's just a question of setting better ehcache
> settings...
>
> Curtis
>
> -------- Message original --------
> Sujet: Re: [Building Sakai] 2.9.1 Performance Issues
> De : David Horwitz <david.horwitz at uct.ac.za>
> <mailto:david.horwitz at uct.ac.za>
> Pour : Sam Ottenhoff <ottenhoff at longsight.com>
> <mailto:ottenhoff at longsight.com>
> Copie à : Curtis Van-Osch <curtis.van-osch at hec.ca>
> <mailto:curtis.van-osch at hec.ca>, sakai-dev Developers
> <sakai-dev at collab.sakaiproject.org>
> <mailto:sakai-dev at collab.sakaiproject.org>
> Date : 2013-07-24 04:54
>> You might want to look at this fix too:
>>
>> https://jira.sakaiproject.org/browse/SAK-23524 (Roster)
>>
>> its a similar pattern to the GB one bellow and caused us some
>> pain.
>>
>> D
>>
>> On Tue, 2013-07-23 at 16:56 -0400, Sam Ottenhoff wrote:
>>> I haven't observed any issues that would explain gigantic
>>> memory usage CPU spiked at 100%. I would try to get a heap
>>> dump into Eclipse MAT as soon as possible.
>>>
>>>
>>> --Sam
>>>
>>>
>>> On Tue, Jul 23, 2013 at 4:53 PM, Curtis Van-Osch
>>> <curtis.van-osch at hec.ca <mailto:curtis.van-osch at hec.ca>> wrote:
>>>
>>> Hello,
>>> We at HEC Montréal recently upgraded to Sakai 2.9.1
>>> (last monday). Everything went well, but we have been
>>> experiencing performance issues ever since. Memory
>>> usage hovers between 6.5 and 8 gigabytes, and CPU usage
>>> often spikes to 100%
>>>
>>> our JAVA_OPTS="-d64 -server -Xmx10g
>>> -Djava.awt.headless=true -Xms512m -XX:MaxPermSize=768m
>>> -XX:PermSize=256m -Duser.language=fr -Duser.region=CA"
>>>
>>> We're planning on inspecting a heap dump tomorrow
>>> morning, and we're looking at applying this Gradebook
>>> patch <https://jira.sakaiproject.org/browse/SAK-23385>
>>> (SAK-23385).
>>>
>>> Does anyone have any other ideas for diagnosing
>>> performance issues?
>>>
>>> --
>>> <http://www.hec.ca>
>>>
>>> Curtis Van Osch Analyste-Programmeur Direction des
>>> technologies de l'information
>>> hec.ca <http://www.hec.ca>
>>> Agréments 3000, chemin de la Côte‑Sainte‑Catherine,
>>> Montréal (Québec) H3T 2A7 Téléphone : 514
>>> 340-6000, poste 2029
>>>
>>>
>>>
>>> recyclez Pensons à l'environnement avant d'imprimer
>>>
>>>
>>> _______________________________________________
>>> sakai-dev mailing list
>>> sakai-dev at collab.sakaiproject.org
>>> <mailto:sakai-dev at collab.sakaiproject.org>
>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>
>>> TO UNSUBSCRIBE: send email to
>>> sakai-dev-unsubscribe at collab.sakaiproject.org
>>> <mailto:sakai-dev-unsubscribe at collab.sakaiproject.org>
>>> with a subject of "unsubscribe"
>>>
>>>
>>>
>>> _______________________________________________
>>> sakai-dev mailing list
>>> sakai-dev at collab.sakaiproject.org <mailto:sakai-dev at collab.sakaiproject.org>
>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>
>>> TO UNSUBSCRIBE: send email tosakai-dev-unsubscribe at collab.sakaiproject.org <mailto:sakai-dev-unsubscribe at collab.sakaiproject.org> with a subject of "unsubscribe"
>>
>> ------------------------------------------------------------------------
>> UNIVERSITY OF CAPE TOWN
>>
>> This e-mail is subject to the UCT ICT policies and e-mail
>> disclaimer published on our website at
>> http://www.uct.ac.za/about/policies/emaildisclaimer/ or
>> obtainable from +27 21 650 9111. This e-mail is intended only
>> for the person(s) to whom it is addressed. If the e-mail has
>> reached you in error, please notify the author. If you are
>> not the intended recipient of the e-mail you may not use,
>> disclose, copy, redirect or print the content. If this e-mail
>> is not related to the business of UCT it is sent by the
>> sender in the sender's individual capacity.
>
>
> --
> <http://www.hec.ca>
>
> Curtis Van Osch
> Analyste-Programmeur
> Direction des technologies de l'information
> hec.ca <http://www.hec.ca>
> Agréments
> 3000, chemin de la Côte‑Sainte‑Catherine, Montréal (Québec)
> H3T 2A7
> Téléphone : 514 340-6000, poste 2029
>
>
> recyclez
> Pensons à l'environnement
> avant d'imprimer
>
>
>
--
<http://www.hec.ca>
Curtis Van Osch
Analyste-Programmeur
Direction des technologies de l'information
hec.ca <http://www.hec.ca>
Agréments
3000, chemin de la Côte‑Sainte‑Catherine, Montréal (Québec) H3T 2A7
Téléphone : 514 340-6000, poste 2029
recyclez
Pensons à l'environnement
avant d'imprimer
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4883 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 345 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0001.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 5127 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0002.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 20493 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment.jpe
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 4883 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0003.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 345 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0004.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 5127 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0005.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 20493 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0001.jpe
-------------- next part --------------
A non-text attachment was scrubbed...
Name: HEC_149px.png
Type: image/png
Size: 4883 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0006.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: hecca.png
Type: image/png
Size: 345 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0007.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 3A-2008.png
Type: image/png
Size: 5127 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment-0008.png
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Feuille_25px.jpg
Type: image/jpeg
Size: 20493 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20130724/66ecafa6/attachment.jpg
More information about the sakai-dev
mailing list