[Building Sakai] Samigo problem with valid submissions getting 0 scores

[Bryan Holladay]

It's interesting that you are having this trouble too... I am working
on an issue just like this.  Its a single page test with a mix of
random multiple choice and fill in the blank.  The instructor noticed
that a few random students had a score of 0 and when she looked at the
submission, the student had quite a few correct multiple choice
answers with a score of 0 (even the check mark was next to it).  She
also found that if you edit the test and regrade and republish that
the score would be fixed but other random students would end up
getting a score of 0.

I'm at a lost and am trying to figure out how to reproduce this
myself.  I have a site that I can see this error where the instructor
gave me permission to "play around with".  This is on 2.8.x + some
additional features in trunk.

-Bryan


On Wed, May 2, 2012 at 1:58 AM, Karen Tsao <ktsao at stanford.edu> wrote:
> Hi Tom,
>
> I don't have any idea regarding your issue at this point. But can you please
> check follow things for me?
>
> For these students who got 0 points, do their answers exist? That is, can
> you see their answers from grading pages? Can you also check if there are
> multiple submissions for these students, from both UI and database.
>
> Thanks,
> Karen
>
>
>
> On Tue, May 1, 2012 at 7:03 PM, Tom Pennings <tom.pennings at gmail.com> wrote:
>>
>> We've been experiencing an issue with Samigo 2.6.2 where, even though
>> all of the students answered all of the questions (some correct, some
>> incorrect) and successfully submitted (with confirmation) the
>> assessment, some of their final scores were recorded as 0.
>>
>> The problem occurred intermittently (10 - 25% of the cases) on two
>> different assessments:
>>
>>  1. 7 parts, each on its own page, a total of 33 questions, all
>> multiple-choice
>>  2. 14 parts, all on one page, a total of 50 questions, all
>> multiple-choice
>>
>> So far we've been unable to find the root cause, or a way to
>> reproduce. What we did find though is that with 'Each Question is on a
>> separate Web page' only individual questions would get submitted as 0,
>> whereas in case of 'The complete Assessment is displayed on one Web
>> page' the whole assessment would evaluate as 0, which seems to suggest
>> an issue during processing of a post though no problems were found in
>> the logs. We've also tested and ruled out session time outs as the
>> reason for the problem.
>>
>> Any suggestions and advice on how to further debug the problem or
>> proposed solutions will be greatly appreciated.
>>
>>
>> Tom
>> _______________________________________________
>> sakai-dev mailing list
>> sakai-dev at collab.sakaiproject.org
>> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>
>> TO UNSUBSCRIBE: send email to
>> sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of
>> "unsubscribe"
>
>
>
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org
> with a subject of "unsubscribe"