[Building Sakai] Course Management : CmSynchronizer JOB : File Size

[Thomas Amsler]

Casey,

Do you guys have your CM update process documented somewhere, that
accessible to the public?
Best,
-- Thomas




On Wed, May 6, 2009 at 11:04 AM, Casey Dunn <caseyd.stan at gmail.com> wrote:
>
>
> On Wed, May 6, 2009 at 10:57 AM, Thomas Amsler <tpamsler at ucdavis.edu> wrote:
>>
>> I am experimenting with loading CM data via the CmSynchronizer Job. Is
>> anybody using this appraoch to load their CM data into the Sakai CM
>> tables? How are folks handling large data set that result int large
>> CMData.xml file. I am dealing with about ~3GB of data.
>>
>> Source Code:
>>
>> https://source.sakaiproject.org/svn/course-management/branches/sakai_2-5-x/cm-impl/hibernate-impl/impl/src/java/org/sakaiproject/coursemanagement/impl/job/
>>
>>
>> Best,
>> -- Thomas
>
> Stanford avoids that problem - the XML is split down to the Course level,
> containing Offerings and their Sections. ( the example CmSynchronizer served
> as an example; there are other Stanford specific tweaks to the feed )
>
> A 3Gig XML file must really be expensive to deal with.
>
> why not knock it apart, Thomas?
>