[Building Sakai] Sakai as a large file dropbox

[Branden Visser]

Thank you everyone for your helpful replies. If there are any out there 
using database storage, I would be interested to hear if they had (or 
have) any hurdles to jump through other than memory.

As far as the JVM heap being the limitation, is there a way to calculate 
how much you would need for an nMb large file? e.g., Is it the entire 
file pulled into the heap before it is unloaded into storage?

Thanks,
Branden

Steve Swinsburg wrote:
> We were restricted by the amount of memory available and adding more was 
> proving to be a hurdle so we hadn't gotten around to getting to the 
> 'very large file support' going. But with that squared away, and the new 
> kernel, very large files should be fine (in 2.7).
> 
> cheers,
> Steve
> 
> 
> 
> On 08/10/2009, at 7:05 PM, David Horwitz wrote:
> 
>> Actually files larger than 2G are only possible with the latest 1.1 
>> range of kernels. This is due to the getContentLength() method in 
>> contenthosting returning an int. Support for file >2G will be 
>> something 2.7 will therefore support
>>
>> D
>>
>> Steve Swinsburg wrote:
>>> At NCeSS in the UK we have an upload limit of around 400Mb. The only 
>>> limiting factor is the amount of JVM heap. We have people wanting to 
>>> upload files in the order of Gb's which should be doable.
>>>
>>> cheers,
>>> Steve
>>>
>>>
>>>
>>> On 08/10/2009, at 5:47 AM, Dave Ross wrote:
>>>
>>>> Once we moved to 2.5.x, in our instance "You can only upload 1000 MB 
>>>> worth of files at one time"
>>>>
>>>> We've tested various .iso files and yes it works.
>>>>
>>>> File storage is NTFS share in front of a SAN.
>>>>
>>>>
>>>>
>>>> On Wed, Oct 7, 2009 at 2:24 PM, Michael Wenk <mjwenk at ucdavis.edu> 
>>>> wrote:
>>>> Branden Visser wrote:
>>>> > Hi everyone,
>>>> >
>>>> > What kind of limits do you put on your file upload sizes? We're 
>>>> running
>>>> > Oracle 10g, storing our content in the database, and our content 
>>>> field
>>>> > currently still has LONG RAW data-type.
>>>> >
>>>> > Aside from using LONG RAW instead of LOB and disk-space, is there
>>>> > anything that would keep us from being able to set, say, a 100Mb file
>>>> > size limit?
>>>> >
>>>> > Thanks,
>>>> > Branden
>>>> > _______________________________________________
>>>> > sakai-dev mailing list
>>>> > sakai-dev at collab.sakaiproject.org
>>>> > http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>> >
>>>> > TO UNSUBSCRIBE: send email to 
>>>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of 
>>>> "unsubscribe"
>>>> >
>>>>
>>>> At UC Davis, we set a file limit of 120 MB.  We use the file system(AFS
>>>> in our case) to store the data.
>>>>
>>>> Mike
>>>>
>>>> _______________________________________________
>>>> sakai-dev mailing list
>>>> sakai-dev at collab.sakaiproject.org
>>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>>
>>>> TO UNSUBSCRIBE: send email to 
>>>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of 
>>>> "unsubscribe"
>>>>
>>>> _______________________________________________
>>>> sakai-dev mailing list
>>>> sakai-dev at collab.sakaiproject.org
>>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>>
>>>> TO UNSUBSCRIBE: send email to 
>>>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of 
>>>> "unsubscribe"
>>>
>>>
>>> ------------------------------------------------------------------------
>>>
>>> _______________________________________________
>>> sakai-dev mailing list
>>> sakai-dev at collab.sakaiproject.org
>>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>
>>> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
> 
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"