[Building Sakai] Getting Too many open files in system error
Steve Swinsburg
steve.swinsburg at gmail.com
Tue Jan 6 12:16:59 PST 2015
On the console/terminal, as the user that you start Tomcat as, run:
ulimit -n
What does it say?
If its still low, you can just add
ulimit -n 10000
to the tomcat/bin/setenv.sh file (create it if it doesn't exist) and you
know it will be set properly for the process.
cheers,
Steve
On Wed, Jan 7, 2015 at 1:23 AM, Pravin G <praving at leotechnosoft.net> wrote:
> Hi All,
>
>
>
> I am still getting below error after changing ulimit to *ulimit -n 25000*
> *in /root/.bashrc* .
>
>
>
> I have not modified anything in /etc/security/limits.conf .
>
>
>
> org.sakaiproject.search.transaction.api.IndexTransactionException: Failed
> to delete documents
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorageUpdateTransactionListener.prepare(JournaledFSIndexStorageUpdateTransactionListener.java:168)
>
> at
> org.sakaiproject.search.transaction.impl.IndexTransactionImpl.firePrepare(IndexTransactionImpl.java:313)
>
> at
> org.sakaiproject.search.transaction.impl.IndexTransactionImpl.prepare(IndexTransactionImpl.java:147)
>
> at
> org.sakaiproject.search.journal.impl.MergeUpdateOperation.runOnce(MergeUpdateOperation.java:94)
>
> at
> org.sakaiproject.search.journal.impl.IndexManagementTimerTask.run(IndexManagementTimerTask.java:137)
>
> at java.util.TimerThread.mainLoop(Timer.java:512)
>
> at java.util.TimerThread.run(Timer.java:462)
>
> Caused by: java.io.FileNotFoundException:
> /home/myserver/apache-tomcat-7.0.26/sakai/indexwork/index/_3.tvx (Too many
> open files in system)
>
> at java.io.RandomAccessFile.open(Native Method)
>
> at
> java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
>
> at
> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.<init>(SimpleFSDirectory.java:78)
>
> at
> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.<init>(SimpleFSDirectory.java:108)
>
> at
> org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.<init>(NIOFSDirectory.java:106)
>
> at
> org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
>
> at
> org.apache.lucene.index.TermVectorsReader.<init>(TermVectorsReader.java:81)
>
> at
> org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(SegmentReader.java:301)
>
> at
> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:669)
>
> at
> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:628)
>
> at
> org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:108)
>
> at
> org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:80)
>
> at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683)
>
> at
> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:73)
>
> at
> org.apache.lucene.index.IndexReader.open(IndexReader.java:476)
>
> at
> org.apache.lucene.index.IndexReader.open(IndexReader.java:314)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getIndexReaderInternal(JournaledFSIndexStorage.java:836)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getIndexReader(JournaledFSIndexStorage.java:745)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getDeletionIndexReader(JournaledFSIndexStorage.java:573)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorageUpdateTransactionListener.prepare(JournaledFSIndexStorageUpdateTransactionListener.java:124)
>
> ... 6 more
>
> 2015-01-06 07:12:24,354 WARN IndexManager
> org.sakaiproject.search.journal.impl.MergeUpdateOperation - Failed to start
> merge operation
>
> org.sakaiproject.search.journal.api.JournalErrorException: Journal is
> stalled at ID 677
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorageUpdateTransactionListener.open(JournaledFSIndexStorageUpdateTransactionListener.java:88)
>
> at
> org.sakaiproject.search.transaction.impl.IndexTransactionImpl.fireOpen(IndexTransactionImpl.java:360)
>
> at
> org.sakaiproject.search.transaction.impl.IndexTransactionImpl.open(IndexTransactionImpl.java:75)
>
> at
> org.sakaiproject.search.journal.impl.MergeUpdateManager.openTransaction(MergeUpdateManager.java:48)
>
> at
> org.sakaiproject.search.journal.impl.MergeUpdateOperation.runOnce(MergeUpdateOperation.java:92)
>
> at
> org.sakaiproject.search.journal.impl.IndexManagementTimerTask.run(IndexManagementTimerTask.java:137)
>
> at java.util.TimerThread.mainLoop(Timer.java:512)
>
> at java.util.TimerThread.run(Timer.java:462)
>
> 2015-01-06 07:12:24,354 INFO IndexManager
> org.sakaiproject.search.journal.impl.MergeUpdateOperation - Local Merge
> Operation
>
>
>
> Can anyone tell how to resolve this.
>
>
>
> Thanks,
>
> -
>
> Pravin
>
>
>
>
>
>
>
>
>
> *From:* sakai-dev-bounces at collab.sakaiproject.org [mailto:
> sakai-dev-bounces at collab.sakaiproject.org] *On Behalf Of *Pravin G
> *Sent:* 05 January 2015 19:03
> *To:* 'Irfan SÜRAL'; sakai-dev at collab.sakaiproject.org
> *Subject:* Re: [Building Sakai] Getting Too many open files in system
> error
>
>
>
> Hi Irfan,
>
>
>
> Ok, but my system is VPS system, and ulimit –n 300000 seems to be so high
> limit value for this .
>
>
>
> Thanks,
>
> -
>
> Pravin
>
>
>
>
>
> *From:* Irfan SÜRAL [mailto:irfansural at gmail.com]
> *Sent:* 05 January 2015 18:36
> *To:* 'Pravin G'; sakai-dev at collab.sakaiproject.org
> *Subject:* RE: [Building Sakai] Getting Too many open files in system
> error
>
>
>
> Hi Pravian
>
>
>
> Actually I don’t need to change anything in /etc/security/limits.conf
>
>
>
> I advise you to add ulimit -n 300000 in /root/.bashrc
>
> Log off and log in then start tomcat see logs
>
>
>
> Irfan
>
>
>
> *From:* Pravin G [mailto:praving at leotechnosoft.net]
> *Sent:* Monday, January 5, 2015 2:54 PM
> *To:* 'Irfan SÜRAL'; sakai-dev at collab.sakaiproject.org
> *Subject:* RE: [Building Sakai] Getting Too many open files in system
> error
>
>
>
> Hi Irfan,
>
>
>
> Hey Thank you for reply.
>
>
>
> I have set this limit i.e
>
> root soft nofile 65536
>
> root hard nofile 65536
>
> * soft nofile 65536
>
> * hard nofile 65536
>
> in etc/security/limits.conf file as a *root user*.
>
>
>
> So do I need to set this ulimit -n 300000 //(I have set in limits.conf
> as a max value i.e 65536) in .bashrc file as *root user* itself? Or both
> files should perform changes using *userxxx ?*
>
>
>
> Thanks,
>
> -
>
> Pravin
>
>
>
> *From:* Irfan SÜRAL [mailto:irfansural at gmail.com <irfansural at gmail.com>]
> *Sent:* 05 January 2015 17:40
> *To:* 'Pravin G'; sakai-dev at collab.sakaiproject.org
> *Subject:* RE: [Building Sakai] Getting Too many open files in system
> error
>
>
>
> Hi
>
>
>
> Make sure your ulimit is activated. Therefore i recommend you to put this
> in .bashrc file
>
>
>
> $ nano /home/userxxx/.bashrc
>
>
>
> ulimit -n 300000
>
>
>
> Once I resolved my pprooblem in this way.
>
>
>
> Irfan
>
>
>
> *From:* sakai-dev-bounces at collab.sakaiproject.org [
> mailto:sakai-dev-bounces at collab.sakaiproject.org
> <sakai-dev-bounces at collab.sakaiproject.org>] *On Behalf Of *Pravin G
> *Sent:* Monday, January 5, 2015 8:17 AM
> *To:* sakai-dev at collab.sakaiproject.org
> *Subject:* [Building Sakai] Getting Too many open files in system error
>
>
>
> Hi I am running sakai 2.9.1, I am getting ‘Too many open files in system ‘
> error many times.
>
>
>
> I have tried to resolve this issue by modifying etc/security/limits.conf
> in this way.
>
>
>
> Added below lines in limits.conf “
>
>
>
> root soft nofile 65536
>
> root hard nofile 65536
>
> * soft nofile 65536
>
> * hard nofile 65536
>
> #ulimit -n 5000
>
>
>
> And after system restart , I am able to see open files size as :65536 &
> others as below.
>
>
>
> core file size (blocks, -c) unlimited
>
> data seg size (kbytes, -d) unlimited
>
> scheduling priority (-e) 0
>
> file size (blocks, -f) unlimited
>
> pending signals (-i) 2062456
>
> max locked memory (kbytes, -l) 64
>
> max memory size (kbytes, -m) unlimited
>
> open files (-n) 65536
>
> pipe size (512 bytes, -p) 8
>
> POSIX message queues (bytes, -q) 819200
>
> real-time priority (-r) 0
>
> stack size (kbytes, -s) 10240
>
> cpu time (seconds, -t) unlimited
>
> max user processes (-u) 2062456
>
> virtual memory (kbytes, -v) unlimited
>
> file locks (-x) unlimited
>
>
>
> But still I am getting errors as :
>
>
>
>
>
> Caused by: java.io.FileNotFoundException:
> /home/apache-tomcat-7.0.26/sakai/indexwork/index/_3_7.del (Too many open
> files in system)
>
> at java.io.RandomAccessFile.open(Native Method)
>
> at
> java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
>
> at
> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.<init>(SimpleFSDirectory.java:78)
>
> at
> org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.<init>(SimpleFSDirectory.java:108)
>
> at
> org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.<init>(NIOFSDirectory.java:106)
>
> at
> org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
>
> at
> org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:703)
>
> at
> org.apache.lucene.util.BitVector.<init>(BitVector.java:221)
>
> at
> org.apache.lucene.index.SegmentReader.loadDeletedDocs(SegmentReader.java:711)
>
> at
> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:671)
>
> at
> org.apache.lucene.index.SegmentReader.get(SegmentReader.java:628)
>
> at
> org.apache.lucene.index.DirectoryReader.<init>(DirectoryReader.java:108)
>
> at
> org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:80)
>
> at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:683)
>
> at
> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:73)
>
> at
> org.apache.lucene.index.IndexReader.open(IndexReader.java:476)
>
> at
> org.apache.lucene.index.IndexReader.open(IndexReader.java:314)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getIndexReaderInternal(JournaledFSIndexStorage.java:836)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getIndexReader(JournaledFSIndexStorage.java:745)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorage.getDeletionIndexReader(JournaledFSIndexStorage.java:573)
>
> at
> org.sakaiproject.search.journal.impl.JournaledFSIndexStorageUpdateTransactionListener.prepare(JournaledFSIndexStorageUpdateTransactionListener.java:124)
>
> ... 6 more
>
>
>
> & sometimes only this :
>
>
>
> org.apache.tomcat.util.net.JIoEndpoint$Acceptor run SEVERE: Socket accept
> failed
>
> java.net.SocketException: Too many open files in system
>
> at java.net.PlainSocketImpl.socketAccept(Native Method)
>
> at
> java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
>
> at java.net.ServerSocket.implAccept(ServerSocket.java:453)
>
> at java.net.ServerSocket.accept(ServerSocket.java:421)
>
> at
> org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
>
> at
> org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
>
> at java.lang.Thread.run(Thread.java:619)
>
>
>
>
>
> Can anyone please guide me how can I resolve this error.
>
>
>
>
>
> Thanks,
>
> -
>
> Pravin
>
>
>
>
>
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to
> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of
> "unsubscribe"
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20150107/dcf971ac/attachment.html
More information about the sakai-dev
mailing list