[Building Sakai] Critical issues on timed assessments

[Raul Sanchez Vegas]

Hi all

I haven't been able to reproduce the first issue on 
http://nightly2.sakaiproject.org:8082.

I think that both issues can be summarized on one issue. I'm going to 
give a better example to reproduce this issue:

1. Instructor creates the 1 minute-timed assessment called "Timed 
Assessment" (attached to this mail) and publishes it.
2. Student takes the assessment at 11:00:00.
3. At 11:00:55 (5 seconds before the time expires) student moves to 
another tool - i.e.: Messages.
4. At 11:01:05 (5 seconds after the time has expired) student goes back 
to the assessment's tool  and takes the assessment again. The student 
will see the attached image on screen: "image1.jpg" (attached to this 
email). So the student is able to answer the questions for a few seconds 
and he is able to submit the assessment.

I think that the problem is on the 4th step: When a student goes back to 
the assessment's tool 5 seconds after time has expired, he is able to 
take the assessment again. I think that this exam should not be 
available for that student.

This might sound weird but we had a similar case last week in a 
assessment that was taken by 300 students.

Regards
Raúl

El 21/11/2012 13:06, Raul Sanchez Vegas escribió:
> Hi Bryan
>
> I've been able to reproduce the second issue on 
> http://nightly2.sakaiproject.org:8082/portal. The steps to reproduce 
> it are:
>
> 1.Create a 10 minutes timed assessment which has only one allowed 
> submission .
>
> 2.The student takes the assessment e.g. at 11:00:00.
>
> 3.When assessment's time is going to finish, the student opens other 
> tool, and he comes back to assessment e.g. at 11:10:20 (20 seconds 
> after time limit is reached which it is 10 minutes). Next the student 
> is able to take the expired assessment. If student takes the 
> assessment, then the time counter shows: "Time's up" however the 
> student is either able to continue the assessment for a few seconds 
> and able to submit it.
>
> I think that both issues could be the same issue because the main 
> problem is that the student is able to take an expired assessment. The 
> issue persists so I think we might create a related Jira, don't you?
>
> Regards,
> Raúl
>
> El 19/11/2012 15:07, Bryan Holladay escribió:
>> Have you tested this on trunk?  If not, please try to reproduce those 
>> issues here: http://nightly2.sakaiproject.org:8082/portal
>>
>> If you can still reproduce them, please file 2 jira tickets under the 
>> Samigo project (SAM) at jira.sakaiproject.org 
>> <http://jira.sakaiproject.org> and mark them as blockers.  If you 
>> need help, just send an email.
>>
>> I have seen something similar to this on a 2.8 instance, but not in 
>> 2.8.x.  I wasn't able to reproduce the issue in 2.9 or trunk, so I 
>> believe it's been addressed (but I couldn't find the commit that 
>> fixed it).  I believe it was fixed with the additional data 
>> validation checks that were added.
>>
>> -Bryan
>>
>> On Mon, Nov 19, 2012 at 6:44 AM, Raul Sanchez Vegas <raulsv at um.es 
>> <mailto:raulsv at um.es>> wrote:
>>
>>     Hi all
>>
>>     We've found 2 critical issues on Samigo. The steps to reproduce
>>     it are:
>>
>>     1.Create a 10 minutes timed assessment which has only one allowed
>>     submission.
>>     2.The student takes the assessment e.g. at 11:00:00.
>>     3.When assessment's time is going to finish, the student opens other
>>     tool, and he comes back to assessment e.g. at 11:10:20 (20
>>     seconds after
>>     time limit is reached which it is 10 minutes). Next the student
>>     is able
>>     to take the expired assessment. If student takes the assessment
>>     and he
>>     closes the browser, the backend java thread submits the
>>     assessment when
>>     new time limit is reached at 11:20:20(ten minutes after last take).
>>
>>
>>     1.Create a 10 minutes timed assessment which has only one allowed
>>     submission .
>>     2.The student takes the assessment e.g. at 11:00:00.
>>     3.When assessment's time is going to finish, the student opens other
>>     tool, and he comes back to assessment e.g. at 11:10:20 (20
>>     seconds after
>>     time limit is reached which it is 10 minutes). Next the student
>>     is able
>>     to take the expired assessment. If student takes the assessment, then
>>     the time counter shows: "Time's up" however the student is either
>>     able
>>     to continue the assessment for a few seconds and able to submit it.
>>
>>
>>     Do you know if there is any related Jira? Has anyone had the same
>>     issue?
>>
>>     Thanks,
>>     Raúl
>>     _______________________________________________
>>     sakai-dev mailing list
>>     sakai-dev at collab.sakaiproject.org
>>     <mailto:sakai-dev at collab.sakaiproject.org>
>>     http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>>
>>     TO UNSUBSCRIBE: send email to
>>     sakai-dev-unsubscribe at collab.sakaiproject.org
>>     <mailto:sakai-dev-unsubscribe at collab.sakaiproject.org> with a
>>     subject of "unsubscribe"
>>
>>
>
>
>
> _______________________________________________
> sakai-dev mailing list
> sakai-dev at collab.sakaiproject.org
> http://collab.sakaiproject.org/mailman/listinfo/sakai-dev
>
> TO UNSUBSCRIBE: send email to sakai-dev-unsubscribe at collab.sakaiproject.org with a subject of "unsubscribe"

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20121123/5ee9c2f0/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Timed Assessment.zip
Type: application/zip
Size: 3390 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20121123/5ee9c2f0/attachment.zip 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image1.JPG
Type: image/jpeg
Size: 47423 bytes
Desc: not available
Url : http://collab.sakaiproject.org/pipermail/sakai-dev/attachments/20121123/5ee9c2f0/attachment.jpe