[Building Sakai] Assignment upload issue

Jaco Gillman jaco at opencollab.co.za
Sat Feb 15 16:17:26 PST 2014 

Might be closer to an solution. I have tested Assignment submission on both
servers, and the uploads only fail on one. The other server is working
fine. So I believe this has something to do with the NFS setup on the
server that fails to write to.

Regards,

*Jaco Gillman*

Java Developer

opencollab

*Tel*: +27 21 970 4017  |  *Fax*: +27 21 914 3098

*Email*: jaco at opencollab.co.za  |  *Skype*: gillmanjc

*Web*: www.opencollab.co.za



On 15 February 2014 12:51, Jaco Gillman <jaco at opencollab.co.za> wrote:

>
> We are using MySQL and the max_allowed_packet size is 512M. Any idea what
> might cause this urgent issue? These directories/files does not exist if
> NFS. I have pasted the rest of the Stacktrace below.
>
> The urgency was that only some Students could not submit their Assignments
> anymore, others seem to be working fine. So I am not 100% sure if it is I
> tried to duplicate the admission of Assignments on 2 different environment
> of the same Sakai version as the Prod instances, but my tests were
> successful.
>
> Only found those exceptions in one of our Prod server's log files. Those
> problematic directories/files that is printed out in log does not exist in
> NFS. I originally though it was permission related, but I have confirmed
> that and all is fine regarding that.
>
>
> (2014-02-14 12:11:24,647
> ajp-bio-11009-exec-152_org.sakaiproject.content.impl.DbContentService) -
> WARN: IOException
> java.io.FileNotFoundException:
> /home/admin/nfs-share/vol1/2014/045/10/efbfecf1-325b-4407-b249-e9e8d96460dd
> (No such file or directory)
>  at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
>  at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
> at
> org.sakaiproject.content.impl.DbContentService$DbStorage.putResourceBodyFilesystem(DbContentService.java:2333)
>  at
> org.sakaiproject.content.impl.DbContentService$DbStorage.commitResource(DbContentService.java:1783)
> at
> org.sakaiproject.content.impl.BaseContentService.commitResourceEdit(BaseContentService.java:5818)
>  at
> org.sakaiproject.content.impl.BaseContentService.commitResource(BaseContentService.java:5629)
> at
> org.sakaiproject.content.cover.ContentHostingService.commitResource(ContentHostingService.java:530)
>  at
> org.sakaiproject.content.tool.ResourcesAction.createResources(ResourcesAction.java:1190)
> at
> org.sakaiproject.content.tool.ResourcesAction.finishAction(ResourcesAction.java:7418)
>  at
> org.sakaiproject.content.tool.ResourcesAction.buildMainPanelContext(ResourcesAction.java:4597)
> at sun.reflect.GeneratedMethodAccessor1449.invoke(Unknown Source)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>  at
> org.sakaiproject.cheftool.VelocityPortletPaneledAction.toolModeDispatch(VelocityPortletPaneledAction.java:441)
> at org.sakaiproject.cheftool.ToolServlet.doGet(ToolServlet.java:236)
>  at
> org.sakaiproject.cheftool.VelocityPortletPaneledAction.doGet(VelocityPortletPaneledAction.java:1168)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
>  at org.sakaiproject.vm.ComponentServlet.service(ComponentServlet.java:56)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
>  at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>  at org.sakaiproject.util.RequestFilter.doFilter(RequestFilter.java:634)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>  at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at
> org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:749)
>  at
> org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:487)
> at
> org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:379)
>  at
> org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:339)
> at
> org.sakaiproject.tool.impl.ActiveToolComponent$MyActiveTool.forward(ActiveToolComponent.java:511)
>  at
> org.sakaiproject.portal.charon.SkinnableCharonPortal.forwardTool(SkinnableCharonPortal.java:1483)
> at
> org.sakaiproject.portal.charon.handlers.ToolHandler.doTool(ToolHandler.java:213)
>  at
> org.sakaiproject.portal.charon.handlers.ToolHandler.doGet(ToolHandler.java:96)
> at
> org.sakaiproject.portal.charon.SkinnableCharonPortal.doGet(SkinnableCharonPortal.java:894)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
>  at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>  at org.sakaiproject.util.RequestFilter.doFilter(RequestFilter.java:695)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>  at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>  at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
> at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
>  at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
>  at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>  at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
> at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)
>  at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:603)
> at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
>  at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>  at java.lang.Thread.run(Thread.java:662)
> (2014-02-14 12:11:24,651
> ajp-bio-11009-exec-152_org.sakaiproject.content.impl.DbContentService) -
> WARN: failed to write file from stream to file
> org.sakaiproject.exception.ServerOverloadException id=failed to write file
> from stream to file
> at
> org.sakaiproject.content.impl.DbContentService$DbStorage.commitResource(DbContentService.java:1824)
>  at
> org.sakaiproject.content.impl.BaseContentService.commitResourceEdit(BaseContentService.java:5818)
> at
> org.sakaiproject.content.impl.BaseContentService.commitResource(BaseContentService.java:5629)
>  at
> org.sakaiproject.content.cover.ContentHostingService.commitResource(ContentHostingService.java:530)
> at
> org.sakaiproject.content.tool.ResourcesAction.createResources(ResourcesAction.java:1190)
>  at
> org.sakaiproject.content.tool.ResourcesAction.finishAction(ResourcesAction.java:7418)
> at
> org.sakaiproject.content.tool.ResourcesAction.buildMainPanelContext(ResourcesAction.java:4597)
>  at sun.reflect.GeneratedMethodAccessor1449.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>  at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.sakaiproject.cheftool.VelocityPortletPaneledAction.toolModeDispatch(VelocityPortletPaneledAction.java:441)
>  at org.sakaiproject.cheftool.ToolServlet.doGet(ToolServlet.java:236)
> at
> org.sakaiproject.cheftool.VelocityPortletPaneledAction.doGet(VelocityPortletPaneledAction.java:1168)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
> at org.sakaiproject.vm.ComponentServlet.service(ComponentServlet.java:56)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>  at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at org.sakaiproject.util.RequestFilter.doFilter(RequestFilter.java:634)
>  at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>  at
> org.apache.catalina.core.ApplicationDispatcher.invoke(ApplicationDispatcher.java:749)
> at
> org.apache.catalina.core.ApplicationDispatcher.processRequest(ApplicationDispatcher.java:487)
>  at
> org.apache.catalina.core.ApplicationDispatcher.doForward(ApplicationDispatcher.java:379)
> at
> org.apache.catalina.core.ApplicationDispatcher.forward(ApplicationDispatcher.java:339)
>  at
> org.sakaiproject.tool.impl.ActiveToolComponent$MyActiveTool.forward(ActiveToolComponent.java:511)
> at
> org.sakaiproject.portal.charon.SkinnableCharonPortal.forwardTool(SkinnableCharonPortal.java:1483)
>  at
> org.sakaiproject.portal.charon.handlers.ToolHandler.doTool(ToolHandler.java:213)
> at
> org.sakaiproject.portal.charon.handlers.ToolHandler.doGet(ToolHandler.java:96)
>  at
> org.sakaiproject.portal.charon.SkinnableCharonPortal.doGet(SkinnableCharonPortal.java:894)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:621)
>  at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>  at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
> at org.sakaiproject.util.RequestFilter.doFilter(RequestFilter.java:695)
>  at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>  at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>  at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>  at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
> at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)
>  at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
> at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)
>  at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)
> at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:603)
>  at
> org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>  at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:662)
> (2014-02-14 12:11:24,694
> ajp-bio-11009-exec-152_org.sakaiproject.content.impl.DbContentService) -
> INFO: Removing resource (/group/05b100c7-564b-477f-96a0-f8cb35f9e7ae/2014
> Master Module Student List.xlsx) content: /home/admin/nfs-share
> (2014-02-14 12:12:03,809
> Finalizer_org.sakaiproject.content.impl.DbContentService) - INFO: Removing
> resource (/group/05b100c7-564b-477f-96a0-f8cb35f9e7ae/2014 Master Module
> Student List.xlsx) content: /home/admin/nfs-share
>
>
>
>
> Regards,
>
> *Jaco Gillman*
>
> Java Developer
>
> opencollab
>
> *Tel*: +27 21 970 4017  |  *Fax*: +27 21 914 3098
>
> *Email*: jaco at opencollab.co.za  |  *Skype*: gillmanjc
>
> *Web*: www.opencollab.co.za
>
>
>
> On 15 February 2014 00:52, Steve Swinsburg <steve.swinsburg at gmail.com>wrote:
>
>> Are you on MySQL? What is your max_allowed_packet param?
>>
>> Also whats the rest of the stacktrace?
>>
>> thanks,
>> Steve
>>
>>
>> On Fri, Feb 14, 2014 at 11:30 PM, Jaco Gillman <jaco at opencollab.co.za>wrote:
>>
>>> Hi All
>>>
>>> We are experiencing Student Assignment upload problems ('The file
>>> upload process is not finished due to server disk i/o error') and here
>>> is what I have found in the logs:
>>>
>>> (2014-02-14 10:32:46,313
>>> ajp-bio-11009-exec-164_org.sakaiproject.content.impl.DbContentService) -
>>> WARN: IOException
>>> java.io.FileNotFoundException:
>>> /home/admin/nfs-share/vol3/2014/045/08/553ded7a-0b3a-4e85-b8c8-96ef466481e4
>>> (No such file or directory
>>>
>>> (2014-02-14 10:32:46,316
>>> ajp-bio-11009-exec-164_org.sakaiproject.content.impl.DbContentService) -
>>> WARN: failed to write file from stream to file
>>> org.sakaiproject.exception.ServerOverloadException id=failed to write
>>> file from stream to file
>>> at
>>> org.sakaiproject.content.impl.DbContentService$DbStorage.commitResource(DbContentService.java:1824)
>>>
>>>
>>>
>>>
>>>
>>> Regards,
>>>
>>> *Jaco Gillman*
>>>
>>> Java Developer
>>>
>>> opencollab
>>>
>>> *Tel*: +27 21 970 4017  |  *Fax*: +27 21 914 3098
>>>
>>> *Email*: jaco at opencollab.co.za  |  *Skype*: gillmanjc
>>>
>>> *Web*: www.opencollab.co.za
>>>
>>>
>>> ------------------------------
>>> See OpenCollab email disclaimer at http://www.opencollab.co.
>>> za/email-disclaimer
>>> _______________________________________________
>>> sakai-dev mailing list
>>> sakai-dev at collab.sakaiproject.org
>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>
>>> TO UNSUBSCRIBE: send email to
>>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of
>>> "unsubscribe"
>>>
>>
>>
>

-- 

------------------------------
See OpenCollab email disclaimer at 
http://www.opencollab.co.za/email-disclaimer
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20140216/aeb9bd64/attachment.html

More information about the sakai-dev mailing list