[samigo-team] Correct behavior for editing published assessment with submissions

[Stephen Marquard]

A quick query on our database shows orphaned answers for these item types:

| Multiple Choice         |
| Multiple Choice Survey  |
| Fill in Blank           |
| Numeric Response        |
| Extended Matching Items |

(the last one here is specific to our T&Q branch).

You can check this in your own db with the SQL:

select SAM_PUBLISHEDITEM_T.ITEMID, SAM_PUBLISHEDITEM_T.SECTIONID, SAM_PUBLISHEDITEM_T.TYPEID from SAM_ITEMGRADING_T INNER JOIN SAM_PUBLISHEDITEM_T ON SAM_ITEMGRADING_T.PUBLISHEDITEMID = SAM_PUBLISHEDITEM_T.ITEMID
WHERE PUBLISHEDANSWERID NOT IN (SELECT ANSWERID FROM SAM_PUBLISHEDANSWER_T);

By "orphaned answer" I mean that there is a student response with an ANSWERID that no longer exists for that published assessment, so the response is effectively meaningless (disconnected from its original context).

I saw this comment in https://jira.sakaiproject.org/browse/SAM-1457 which I would endorse:

"** Ultimately, we want a property to allow editing of question point values and/or correct responses, and subsequently to regrade and republish, without also allowing edits to the text of a published question when submissions have already occurred."

as the primary use-case for editing published assessments after submissions seems to be to change the grading rather than the question text or set of responses.

Cheers
Stephen

---
Stephen Marquard, Acting Director
Centre for Educational Technology, University of Cape Town
http://www.cet.uct.ac.za<http://www.cet.uct.ac.za/>
stephen.marquard at uct.ac.za<mailto:stephen.marquard at uct.ac.za>
Phone: +27-21-650-5037 Cell: +27-83-500-5290

From: samigo-team-bounces at collab.sakaiproject.org [mailto:samigo-team-bounces at collab.sakaiproject.org] On Behalf Of Ward, Lynn E.
Sent: 05 July 2013 10:40 PM
To: Karen Tsao; Ramachandran,Narasi
Cc: samigo-team at collab.sakaiproject.org
Subject: Re: [samigo-team] Correct behavior for editing published assessment with submissions

I know we've had cases where questions were scored incorrectly if answer choices were removed or added.  Ideally, I'd like to see edits limited to changing the text for the question and answer choices or choosing a different correct answer.

Lynn
==========================
Lynn Ward, Principal Systems Analyst
Instructional Technology Systems and Services
University Information Technology Services<http://uits.iu.edu/>
Indiana University
Information Technology and Communications Complex (IT 342K)
535 West Michigan Street, Indianapolis, IN 46202
Phone: 317-278-5713  E-mail: leward at iu.edu<mailto:leward at iu.edu>

From: 'Karen Tsao' <ktsao at stanford.edu<mailto:ktsao at stanford.edu>>
Date: Friday, July 5, 2013 2:23 PM
To: "Ramachandran,Narasi" <rnarasi at ufl.edu<mailto:rnarasi at ufl.edu>>
Cc: Samigo Team <samigo-team at collab.sakaiproject.org<mailto:samigo-team at collab.sakaiproject.org>>
Subject: Re: [samigo-team] Correct behavior for editing published assessment with submissions

Hi Stephen,

By design, users cannot add/remove questions but can add/remove the answer choices for published assessments. If you think this introduce complication in grading, we are open to discuss.

Hi Nariasi,
So you remove the option to add/remove answer choices in your local system?

Thanks,
Karen

On Thu, Jul 4, 2013 at 6:41 AM, Ramachandran,Narasi <rnarasi at ufl.edu<mailto:rnarasi at ufl.edu>> wrote:
We have only been able to modify the options not remove a question or answer choice.
Hope that helps.
Narasi
Univ of Florida

Thanks,
Narasi

On Jul 4, 2013, at 7:07 AM, "Stephen Marquard" <stephen.marquard at uct.ac.za<mailto:stephen.marquard at uct.ac.za>> wrote:
Hi all

We are looking at an issue with EMIs (only in our 2-9-x branch) where the question is changed in a published assessment after there are already submissions.

I was wondering what the expected behaviour should be for auto-scored question types (e.g. MC). For example should it be possible to remove an answer option?

Regards
Stephen

---
Stephen Marquard, Acting Director
Centre for Educational Technology, University of Cape Town
http://www.cet.uct.ac.za<http://www.cet.uct.ac.za/>
stephen.marquard at uct.ac.za<mailto:stephen.marquard at uct.ac.za>
Phone: +27-21-650-5037<tel:%2B27-21-650-5037> Cell: +27-83-500-5290<tel:%2B27-83-500-5290>

________________________________
UNIVERSITY OF CAPE TOWN

This e-mail is subject to the UCT ICT policies and e-mail disclaimer published on our website at http://www.uct.ac.za/about/policies/emaildisclaimer/ or obtainable from +27 21 650 9111<tel:%2B27%2021%20650%209111>. This e-mail is intended only for the person(s) to whom it is addressed. If the e-mail has reached you in error, please notify the author. If you are not the intended recipient of the e-mail you may not use, disclose, copy, redirect or print the content. If this e-mail is not related to the business of UCT it is sent by the sender in the sender's individual capacity.
_______________________________________________
samigo-team mailing list
samigo-team at collab.sakaiproject.org<mailto:samigo-team at collab.sakaiproject.org>
http://collab.sakaiproject.org/mailman/listinfo/samigo-team

_______________________________________________
samigo-team mailing list
samigo-team at collab.sakaiproject.org<mailto:samigo-team at collab.sakaiproject.org>
http://collab.sakaiproject.org/mailman/listinfo/samigo-team
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://collab.sakaiproject.org/pipermail/samigo-team/attachments/20130708/488d3207/attachment.html