[Building Sakai] MySql binary files to File Server hosting conversion

[Steve Swinsburg]

Hi,

Sorry I missed the log file in the last post, got it now. What are the permissions on /opt/tomcat/sakai/content/ ? As an aside, its probably best to move this outside of your tomcat directory. Also, it looks like you are using Melete.  I have copied in the Melete team who can hopefully provide some confirmation that Melete files do participate in the conversion fromDB to FS storage.

I think the main problem is that you are running out of resources:
java.lang.RuntimeException: org.sakaiproject.exception.ServerOverloadException id=failed to write file from byte-array to file

From the Javadoc:
ServerOverloadException is thrown whenever a request cannot be completed at this time due to some critical resource of the server being in too short supply.

What are your JAVA_OPTS?

Also, how many records do you have in your  CONTENT_RESOURCE_BODY_BINARY table? And how many have content in them for the XML field? Cross check these records with the CONTENT_RESOURCE field and check the filesize. Large files might be causing the ServerOverloadException since they may be being read into memory all at once.

cheers,
Steve



On 10/03/2010, at 8:44 AM, Nawaz Azam wrote:

> I have done that. I sent the catalina.out file. Were you able to get it.  Where else should I look for these log files. Would they be in  /opt/tomcat/logs/   or somewhere else? 
> 
> 
> Thanks,
> Nawaz.                          
> 
> 
> Nawaz Azam
> Technical Support Specialist
> Manchester Community College
> 1066 Front Street, Manchester, NH 03102
> Work. (603) 668-6706 ext. 313
> Cell.    (603) 396-1356
> nazam at ccsnh.edu
> Opportunities. For Now ... For Life
> www.manchestercommunitycollege.edu
>                            
> 
> 
> -----Original Message-----
> From: Steve Swinsburg [mailto:steve.swinsburg at gmail.com] 
> Sent: Tuesday, March 09, 2010 4:33 PM
> To: Nawaz Azam
> Cc: Seth Theriault; Naim Syed; sakai-dev at collab.sakaiproject.org
> Subject: Re: [Building Sakai] MySql binary files to File Server hosting conversion
> 
> Hi,
> 
> Can you turn up the logging level via this in sakai.properties:
> 
>> log.config.count=1
>> log.config.1 = DEBUG.org.sakaiproject.content
> 
> 
> 
> Might need a few more log.config lines but we can go from there. Might be permissions issue, but if the tomcat user can write directories it should be able to write the files. The logs should be able to tell us what is going on.
> 
> cheers,
> Steve
> 
> 
> On 10/03/2010, at 5:22 AM, Nawaz Azam wrote:
> 
>> I tried that and still stuck at the same place. Do you think it might be permission issue there? It create the volumes and about 3 files init. I am attaching the catalina.out for this startup. Please take a look and I might be just missing something.
>> 
>> Thanks,
>> Nawaz.
>> 
>> 
>> 
>> -----Original Message-----
>> From: Steve Swinsburg [mailto:steve.swinsburg at gmail.com] 
>> Sent: Monday, March 08, 2010 6:18 PM
>> To: Nawaz Azam
>> Cc: Seth Theriault; Naim Syed; sakai-dev at collab.sakaiproject.org
>> Subject: Re: [Building Sakai] MySql binary files to File Server hosting conversion
>> 
>> Hi,
>> 
>> I just ran the conversion on a set of data in a trunk install and it worked fine with these settings:
>> 
>> bodyPath at org.sakaiproject.content.api.ContentHostingService = ${sakai.home}content
>> bodyVolumes at org.sakaiproject.content.api.ContentHostingService = vol1,vol2,vol3
>> convertToFile at org.sakaiproject.content.api.ContentHostingService = true
>> 
>> Could you turn up the logging level so you get a bit more output?
>> 
>> Something like this in sakai.properties:
>> 
>> log.config.count=1
>> log.config.1 = DEBUG.org.sakaiproject.content
>> 
>> Then startup and see what it outputs.
>> 
>> cheers,
>> Steve
>> 
>> 
>> 
>> On 09/03/2010, at 10:01 AM, Nawaz Azam wrote:
>> 
>>> Hello Seth,
>>>   Thanks for replying. If you scroll down I have tried that.
>>> 
>>>   bodyPath at org.sakaiproject.content.api.ContentHostingService = /opt/content/
>>> 
>>>   bodyVolumes at org.sakaiproject.content.api.ContentHostingService = vol1,vlo2,vol3
>>> 
>>>   convertToFile at org.sakaiproject.content.api.ContentHostingService = true
>>> 
>>> 
>>> 
>>> It creates the additional folders and 3 files inside it. Both times. The total size of content folder is 124K. Please advise. 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> Nawaz Azam
>>> Technical Support Specialist
>>> Manchester Community College
>>> 1066 Front Street, Manchester, NH 03102
>>> Work. (603) 668-6706 ext. 313
>>> Cell.    (603) 396-1356
>>> nazam at ccsnh.edu
>>> Opportunities. For Now ... For Life
>>> www.manchestercommunitycollege.edu
>>> 
>>> 
>>> 
>>> -----Original Message-----
>>> From: Seth Theriault [mailto:slt at columbia.edu] 
>>> Sent: Monday, March 08, 2010 5:58 PM
>>> To: Nawaz Azam
>>> Cc: sakai-dev at collab.sakaiproject.org
>>> Subject: Re: [Building Sakai] MySql binary files to File Server hosting conversion
>>> 
>>> Nawaz Azam wrote:
>>> 
>>>> bodyVolumes at org.sakaiproject.content.api.ContentHostingService  = /files
>>> 
>>> This line is suspect. Try removing the "/" and seeing if:
>>> 
>>> /opt/tomcat/sakai/content/files
>>> 
>>> is created.
>>> 
>>> Seth
>>> 
>>> 
>>> _______________________________________________
>>> sakai-dev mailing list
>>> sakai-dev at collab.sakaiproject.org
>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>> 
>>> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
>> 
>> <catalina_out.txt>
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20100310/cefb1f50/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3689 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20100310/cefb1f50/attachment.bin