[WG: Sakai QA] Fwd: [Building Sakai] Critical issues on timed assessments

Raul Sanchez Vegas raulsv at um.es
Thu Nov 22 04:09:54 PST 2012


Hi Karen

I haven't been able to reproduce the first issue on 
http://nightly2.sakaiproject.org:8082.

I think that both issues can be summarized on one issue. I'm going to 
give a better example to reproduce this issue:

1. Instructor creates the 1 minute-timed assessment called "Timed 
Assessment" (attached to this mail) and publishes it.
2. Student takes the assessment at 11:00:00.
3. At 11:00:55 (5 seconds before the time expires) student moves to 
another tool - i.e.: Messages.
4. At 11:01:05 (5 seconds after the time has expired) student goes back 
to the assessment's tool  and takes the assessment again. The student 
will see the attached image on screen: "image1.jpg" (attached to this 
email). So the student is able to answer the questions for a few seconds 
and he is able to submit the assessment.

I think that the problem is on the 4th step: When a student goes back to 
the assessment's tool 5 seconds after time has expired, he is able to 
take the assessment again. I think that this exam should not be 
available for that student.

This might sound weird but we had a similar case last week in a 
assessment that was taken by 300 students.

Regards
Raúl

El 22/11/2012 1:07, Karen Tsao escribió:
> Hi Raul,
>
> I can reproduce your first issue. When I tried to submit the 
> assessment after time run out, I got "Your assessment has been 
> submitted" error and the assessment is automatically submitted couple 
> of seconds later. And then after 10 min, another blank assessment got 
> automatically submitted. So instead of submitting the assessment 10 
> min later (as you described), there actually are two submissions. I 
> believe you also have two submissions - one is around 11:10:00 and one 
> around 11:20:00. Can you please double check?
>
> I couldn't reproduce your second issue. Depending on when I go back to 
> the assessment, I either get "Your assessment has been submitted" 
> error or "Data discrepancy" error. I have never been able to 
> successfully submit the assessment.
>
> Thanks,
> Karen
>
>
> On Wed, Nov 21, 2012 at 10:26 AM, Oliver Williams 
> <oliver at opencollab.co.za <mailto:oliver at opencollab.co.za>> wrote:
>
>     Hi Neal,
>
>     I can look at this tomorrow morning, so in about 13 hours time if
>     somebody doesn't get to it first!
>
>     Regards,
>     Oliver
>
>
>     On 21 Nov 2012, at 8:21 PM, Neal Caidin
>     <nealcaidin at sakaifoundation.org
>     <mailto:nealcaidin at sakaifoundation.org>> wrote:
>
>>     Hi All,
>>
>>     I don't know if anybody has time to verify the issue below which
>>     went to the Dev list. I don't see an existing Jira for this yet.
>>     Raul verified on trunk, but would be nice to get another pair of
>>     eyes on it and/or start the Jira process.
>>
>>     Thanks,
>>
>>     Neal Caidin
>>
>>     Sakai CLE Community Coordinator
>>     nealcaidin at sakaifoundation.org
>>     <mailto:nealcaidin at sakaifoundation.org>
>>     Skype: nealkdin
>>     AIM: ncaidin at aol.com <mailto:ncaidin at aol.com>
>>
>>
>>
>>
>>     Begin forwarded message:
>>
>>>     *From: *Raul Sanchez Vegas <raulsv at um.es <mailto:raulsv at um.es>>
>>>     *Subject: **[Building Sakai] Critical issues on timed assessments*
>>>     *Date: *November 19, 2012 6:44:22 AM EST
>>>     *To: *sakai-dev <sakai-dev at collab.sakaiproject.org
>>>     <mailto:sakai-dev at collab.sakaiproject.org>>
>>>
>>>     Hi all
>>>
>>>     We've found 2 critical issues on Samigo. The steps to reproduce
>>>     it are:
>>>
>>>     1.Create a 10 minutes timed assessment which has only one allowed
>>>     submission.
>>>     2.The student takes the assessment e.g. at 11:00:00.
>>>     3.When assessment's time is going to finish, the student opens
>>>     other
>>>     tool, and he comes back to assessment e.g. at 11:10:20 (20
>>>     seconds after
>>>     time limit is reached which it is 10 minutes). Next the student
>>>     is able
>>>     to take the expired assessment. If student takes the assessment
>>>     and he
>>>     closes the browser, the backend java thread submits the
>>>     assessment when
>>>     new time limit is reached at 11:20:20(ten minutes after last take).
>>>
>>>
>>>     1.Create a 10 minutes timed assessment which has only one allowed
>>>     submission .
>>>     2.The student takes the assessment e.g. at 11:00:00.
>>>     3.When assessment's time is going to finish, the student opens
>>>     other
>>>     tool, and he comes back to assessment e.g. at 11:10:20 (20
>>>     seconds after
>>>     time limit is reached which it is 10 minutes). Next the student
>>>     is able
>>>     to take the expired assessment. If student takes the assessment,
>>>     then
>>>     the time counter shows: "Time's up" however the student is
>>>     either able
>>>     to continue the assessment for a few seconds and able to submit it.
>>>
>>>
>>>     Do you know if there is any related Jira? Has anyone had the
>>>     same issue?
>>>
>>>     Thanks,
>>>     Raúl
>>>     _______________________________________________
>>>     sakai-dev mailing list
>>>     sakai-dev at collab.sakaiproject.org
>>>     <mailto:sakai-dev at collab.sakaiproject.org>
>>>     http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>>
>>>     TO UNSUBSCRIBE: send email to
>>>     sakai-dev-unsubscribe at collab.sakaiproject.org
>>>     <mailto:sakai-dev-unsubscribe at collab.sakaiproject.org> with a
>>>     subject of "unsubscribe"
>>
>>     _______________________________________________
>>     sakai-qa mailing list
>>     sakai-qa at collab.sakaiproject.org
>>     <mailto:sakai-qa at collab.sakaiproject.org>
>>     http://collab.sakaiproject.org/mailman/listinfo/sakai-qa
>>
>>     TO UNSUBSCRIBE: send email to
>>     sakai-qa-unsubscribe at collab.sakaiproject.org
>>     <mailto:sakai-qa-unsubscribe at collab.sakaiproject.org> with a
>>     subject of "unsubscribe"
>
>     _______________________________________________
>     sakai-qa mailing list
>     sakai-qa at collab.sakaiproject.org
>     <mailto:sakai-qa at collab.sakaiproject.org>
>     http://collab.sakaiproject.org/mailman/listinfo/sakai-qa
>
>     TO UNSUBSCRIBE: send email to
>     sakai-qa-unsubscribe at collab.sakaiproject.org
>     <mailto:sakai-qa-unsubscribe at collab.sakaiproject.org> with a
>     subject of "unsubscribe"
>
>
>
>
> _______________________________________________
> sakai-qa mailing list
> sakai-qa at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-qa
>
> TO UNSUBSCRIBE: send email to sakai-qa-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-qa/attachments/20121122/982557d8/attachment-0001.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Timed Assessment.zip
Type: application/x-zip-compressed
Size: 3390 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-qa/attachments/20121122/982557d8/attachment-0001.bin 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image1.JPG
Type: image/jpeg
Size: 47423 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-qa/attachments/20121122/982557d8/attachment-0001.jpe 


More information about the sakai-qa mailing list