[Building Sakai] POLL: performance storing resource bodies in SQL database vs network-filesystem

Steve Swinsburg s.swinsburg at lancaster.ac.uk
Tue May 12 03:10:05 PDT 2009


Do you mean for database vs filesystem storage, or an offsite database?


cheers,
Steve





On 12 May 2009, at 10:49, Gopal Patil wrote:

> Also if your file size is in GB, then it gone give some problems to  
> you.
>
> Cheers,
> Gopal
>
> On Tue, May 12, 2009 at 2:40 PM, Steve Swinsburg <s.swinsburg at lancaster.ac.uk 
> > wrote:
> Regarding conversion later on, you might want to take a look at both  
> of these Jiras, as there was an issue converting from DB >  
> filesystem if you've already upgraded your DB to use binary  
> serialisation as opposed to the XML serialisation in 2.4:
>
> http://jira.sakaiproject.org/jira/browse/KNL-164
> http://jira.sakaiproject.org/jira/browse/SAK-16146
>
> That being said, a production installation I look after has its  
> files stored in an Oracle cluster ~30 km away and there are no issues.
>
> cheers,
> Steve
>
> ---
> Steve Swinsburg
> Portal Systems Developer
> Centre for e-Science
> Lancaster University
> Lancaster
> LA1 4YT
>
> email: s.swinsburg at lancaster.ac.uk
> phone: +44 (0) 1524 594870
>
>
>
>
>
>
>
>
> On 12 May 2009, at 06:12, Luke Fernandez wrote:
>
> The perennial question; it keeps cropping up again and again.  I
> recommend blob storage if you have the DB infrastructure to support
> it.  Here are the reasons why:
>
> 1) Its easier to do backups because you don't have to do
> synchronization management between your db and filestorage.
>
> 2) If you find after a while that you suffer a performance hit using
> blobs you always have some out of the box scripts you can use to move
> to file storage (you can do it the other way -- we did -- but we had
> to write out own scripts).
>
> Whatever you do, consult first with your DBAs.  I made the mistake of
> taking my cues from what the Sakai mainstream orthodox recommendation
> was (e.g. filestorage).  But our DBAs didn't like it so we switched
> back to blobs a few months after we'd deployed live.
>
> Luke
>
>
>
> On Mon, May 11, 2009 at 11:01 PM, will at serensoft.com <will at serensoft.com 
> > wrote:
> Hey folks --
>
> In your experience, which of the two is more responsive?
>
> A) storing resources as blobs in networked SQL database fields (where
> sql db is on a machine different from where tomcat is serving web
> pages)
>
> B) storing resources on networked file storage (where files are
> served/saved on a machine different from where tomcat is serving web
> pages)
>
> If the answer is "it depends" we'd love to hear the context. Your
> input and suggestions will be greatly appreciated.
>
> Thanks!
>
> --
> will trillich
> "Our only real economic security lies in our power to meet human
> needs." -- S.Covey, the 8th Habit
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org 
>  with a subject of "unsubscribe"
>
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org 
>  with a subject of "unsubscribe"
>
>
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org 
>  with a subject of "unsubscribe"
>
>
>
> -- 
> Gopal

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20090512/e33f1f87/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2437 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20090512/e33f1f87/attachment.bin 


More information about the sakai-dev mailing list