[Building Sakai] elasticsearch on 10.x

[Stephen Marquard]

Hi all,

We recently had to turn off elasticsearch on our production cluster because one or two of the app servers would run out of memory almost immediately on startup (6G heap).

There is an ES upgrade in the works to 1.1.2 in https://jira.sakaiproject.org/browse/SAK-27685 which may fix this. However, it still seems risky to run elasticsearch with indexing on app servers (as content digesting can also be slow and cause lots of GC sometimes). We are considering a setup where the app servers with user sessions have ES data.node = false, and we have 2 dedicated ES app servers which hold the indexes (shards and replicas) with data.node = true.

Has anyone run such a setup with Sakai? This would be similar to legacy search where there's a dedicated search node and the app servers use a search webservice to talk to it.

Regards
Stephen

---
Stephen Marquard, Learning Technologies Co-ordinator
Centre for Innovation in Learning and Teaching (CILT, formerly CET and HAESDU)
University of Cape Town
http://www.cet.uct.ac.za<http://www.cet.uct.ac.za/>
stephen.marquard at uct.ac.za<mailto:stephen.marquard at uct.ac.za>
Phone: +27-21-650-5037 Cell: +27-83-500-5290

________________________________
UNIVERSITY OF CAPE TOWN

This e-mail is subject to the UCT ICT policies and e-mail disclaimer published on our website at http://www.uct.ac.za/about/policies/emaildisclaimer/ or obtainable from +27 21 650 9111. This e-mail is intended only for the person(s) to whom it is addressed. If the e-mail has reached you in error, please notify the author. If you are not the intended recipient of the e-mail you may not use, disclose, copy, redirect or print the content. If this e-mail is not related to the business of UCT it is sent by the sender in the sender's individual capacity.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20140729/cc6ec742/attachment.html