[WG: Sakai QA] Update - Re: QA team report on Sakai 2.9.3 release candidate

Wed Aug 14 10:29:22 PDT 2013

FYI - The LDAP issues are for post 2.9.3 per the meeting minutes from last week - http://etherpad.ctools.org/rmmt-2013-08-08

Thanks

On Aug 14, 2013, at 1:12 PM, Neal Caidin <neal.caidin at apereo.org> wrote:

> Update
> ---------------
> 
> * WebDav - appears to be working on 2.9.x and 2.9.3-RC03 with WebDav changes (kind of like an RC04 / on Longsight server).  Tested on Windows 7, Mac OS X, and AnyClient.  Would be nice to have a little more testing but we had at least several folks try it out.  BTW, Longsight server has 10 meg file quota limit per QA team request. Could make it tricky to test, so I think 2.9.x nightly is a better place for now?
> 
> * https://jira.sakaiproject.org/browse/SAK-23755  - looks like it is fine. Problems reported appear related to https://jira.sakaiproject.org/browse/KNL-1099 and not to this ticket.
> 
> * https://jira.sakaiproject.org/browse/SAM-973 - since the decision to move forward with CLE 2.9.3, it appears that the data issue with existing assessments, impacted by an upgrade to CLE 2.9.3 , has been fixed in trunk.  Does this mean we need an RC05 ?  
> 
> I'm not seeing anything that would prevent us from releasing CLE 2.9.3 , unless we merge the additional fixes for SAM-973, and then take another day or so for testing (would need volunteer tester with existing assessment data with Fill In the Blank question types). 
> 
> Also, I think there are three LDAP issues that we were hoping to get into 2.9.3 , but which have not yet been verified or merged. I don't think these are blockers for the release.
> 
> https://jira.sakaiproject.org/browse/SAK-23719 - may not be testable? 
> https://jira.sakaiproject.org/browse/SAK-23689
> https://jira.sakaiproject.org/browse/SAK-23362
> 
> Comments and questions welcome.
> 
> Cheers,
> Neal
> 
> Neal Caidin
> Sakai CLE Community Coordinator
> neal.caidin at apereo.org
> Skype: nealkdin
> Twitter: ncaidin
> 
> 
> 
> 
> 
> 
> 
> 
> 
> On Aug 13, 2013, at 12:13 PM, Neal Caidin <neal.caidin at apereo.org> wrote:
> 
>> Summary
>> ------------------
>> QA team would like more time to test, at least a day or two more.
>> 
>> 
>> Details
>> ----------------
>> * WebDav initial testing is having mixed results. QA team would like more time to test. Triggered by the reversion of this ticket - https://jira.sakaiproject.org/browse/SAK-19592
>> * https://jira.sakaiproject.org/browse/SAK-23755  is a potential blocker for 2.9.3 based on the comments from Brian Jones, Western University.  So far QA team has not been able to reproduce Brian's reports. Need more time for testing. 
>> * A couple of other issues we would also like to test, though would not likely rise to blocker-level
>> 
>> 
>> Thanks,
>> Neal
>> 
>> 
>> Neal Caidin
>> Sakai CLE Community Coordinator
>> neal.caidin at apereo.org
>> Skype: nealkdin
>> Twitter: ncaidin
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> On Aug 13, 2013, at 7:51 AM, Neal Caidin <neal.caidin at apereo.org> wrote:
>> 
>>> The QA team (or at least a couple of us testers) is meeting later this morning . We will report back what successes/failures we have and if we see any showstoppers. So far, I'm not aware of any showstoppers for the CLE 2.9.3 release. 
>>> 
>>> Since we will be releasing CLE 2.9.3 with SAM-973 included, but without a data fix for existing quizzes, here is some draft language I came up with:
>>> 
>>> 
>>> Release Notes
>>> ---------------------------------------------------------------
>>> SAM-973 fixes an issue with the Fill-in-the-blank question type(aka FITB). A side effect is that existing assessments, after upgrading to CLE 2.9.3 , will show incorrect feedback to the student on any questions of type FITB. Student grades are not affected, and assessments created after upgrading to CLE 2.9.3 are not affected.
>>> 
>>> Details - All the FITB answers for previously existing assessments will show red x's, indicating a incorrect answers, regardless if some or all of the answers are correct or not. To reiterate, student grades are not affected, only the feedback of assessments existing before the upgrade are affected. New Assessments, created after the upgrade, will display FITB feedback correctly. SAM-973 is a necessary fix so that future assessments with FITB questions will properly display feedback to the student in all situations.
>>> 
>>> -------------------------------------------------
>>> 
>>> (Feedback and edits welcome.)
>>> 
>>> Cheers,
>>> Neal
>>> 
>>> 
>>> Neal Caidin
>>> Sakai CLE Community Coordinator
>>> neal.caidin at apereo.org
>>> Skype: nealkdin
>>> Twitter: ncaidin
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Aug 12, 2013, at 3:58 PM, Noah Botimer <botimer at umich.edu> wrote:
>>> 
>>>> I missed the calls but I value releases highly, especially for Q3 given our adoption base, and recommend proceeding with a known issue list. There is significant risk of fragmentation without releases and there are plenty of desirable fixes queued up and tested.
>>>> 
>>>> There should be another release as soon as practicable with additional fixes. Pushing back my daredevil side and borrowing wisdom from others, I feel it unlikely to get a complete and confident resolution to this under the wire.
>>>> 
>>>> I support your position, Sam.
>>>> 
>>>> Thanks,
>>>> -Noah
>>>> 
>>>> On Aug 12, 2013, at 3:35 PM, Sam Ottenhoff wrote:
>>>> 
>>>>> On the call last Thursday, we agreed to wait until today (Monday) on a resolution to the previous-exam fill-in-the-blank question display.  I don't believe we are close enough to a complete resolution.  I believe we should heed the advice of others on the call who urged releasing before the Fall term begins.
>>>>> 
>>>>> Here is SAM-973 and the latest comments from UVA/Longsight/Stanford:
>>>>> 
>>>>> https://jira.sakaiproject.org/browse/SAM-973
>>>>> 
>>>>> Does anyone disagree and want to make a stand that we need to wait for SAM-973 to be completely resolved (i.e., old exam FIB results will display correctly)?
>>>>> 
>>>>> --Sam
>>>>> _______________________________________________
>>>>> cle-release-team mailing list
>>>>> cle-release-team at collab.sakaiproject.org
>>>>> http://collab.sakaiproject.org/mailman/listinfo/cle-release-team
>>>> 
>>>> _______________________________________________
>>>> cle-release-team mailing list
>>>> cle-release-team at collab.sakaiproject.org
>>>> http://collab.sakaiproject.org/mailman/listinfo/cle-release-team
>>> 
>> 
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-qa/attachments/20130814/a2ad0e45/attachment-0001.html 