[Deploying Sakai] "Too many open files" and search indexing

Colin Tatham colin.tatham at unimelb.edu.au
Sun Nov 13 22:42:47 PST 2011


Hi

I'm having some issues with configuring the Sakai search. We're running 
2.8.0

I found some posts in the Sakai mail list archives which helped with the 
configuration, and I can post my config details if it helps, but my 
current problem is that when rebuilding or refreshing the index, I'm 
getting errors like this:

2011-11-14 16:25:59,130  WARN IndexManager 
org.sakaiproject.search.indexer.impl.TransactionalIndexWorker -  Failed 
to index document for /site/~0ec94356-874b-4d56-b786-75968047c257 cause: 
/servers/sakai_home/search/indexwork/indexer-work/indextx-1321247227312/_kb.tvx 
(Too many open files)
java.io.FileNotFoundException: 
/servers/sakai_home/search/indexwork/indexer-work/indextx-1321247227312/_kb.tvx 
(Too many open files)

I found some suggestions that the limit needed to be increased in the 
OS. That did seem to be the problem initially:

[sakai at crete ~]$ ulimit -n
1024

I checked how many files it had open when the problem occurred:
[sakai at crete ~]$ /usr/sbin/lsof -p 28760 | wc -l
1672

We increased the value set in /etc/security/limits.conf:

*  soft   nofile    65535
*  hard   nofile    65535

which seems to have changed the limit:
[sakai at crete ~]$ ulimit -n
65535

but I still get the errors?

Would using 2.8.1 or the latest version of the search tool solve this issue?

Thanks

Colin

-- 
Colin Tatham
Educational Technologist | Learning Environments
University Library | The University of Melbourne
http://www.trs.unimelb.edu.au


More information about the production mailing list