[samigo-team] Feedback UI -- clarifying the dependencies

[Regan, Alan]

Thank you, Roger.  Good revision!

Sorry for any confusion, btw.  I agree with Roger that Grader's comments can be independent.  I can definitely see where professors might want to provide individual written feedback to students but not necessarily expose the responses.  From my local testing, "grader's comments" are currently dependent on student response and won't display otherwise.  That's why I had nested it originally.  Good catch, Roger!

So I think this is the suggestion on the table?
1.) In the design, please communicate any dependencies. Gray out or hide options that require another selection first.
2.) Please allow Grader's Comments to display without requiring Student Response to be selected.
3.) Please consider breaking student scores into separate items: Overall Score, Part Score(s), Question Score(s).

Does this sound right?

Sincerely,

Alan Regan, MFA
Manager, Technology and Learning
Information Technology
Pepperdine University
(310) 506-6756


________________________________________
From: Henry, Roger James [rjhenry at indiana.edu]
Sent: Tuesday, February 21, 2012 7:10 AM
To: Regan, Alan; samigo-team at collab.sakaiproject.org
Subject: RE: Feedback UI -- clarifying the dependencies

Hi All,

I second Alan’s motion, with one small point of difference.

In his suggestion for a revised layout for the feedback options, he nests ‘grader comments’ along with Question- and Selection-level feedback under ‘Student Response.’ I would disagree that ‘grader comments’ should depend on ‘student response.’ I can think of scenarios where an instructor would wish to return general comments about the student’s performance without necessarily releasing the student’s responses.

To a separate question of what scores to display, the system currently presents two options: ‘Student’s Assessment Scores,’ and ‘Student’s Question and Part Scores.’ I would suggest that we separate question scores from part scores. So we would then have three options:

It might look something like this (building upon Alan’s suggested revision):

·         Student Response

o   Question-Level Feedback

o   Selection-Level Feedback

·         Correct Response

·         Student's Scores

o   Overall Assessment Score

o   Part Scores

o   Question Scores

·         Grader's General Comments

·         Statistics and Histograms


Roger J. Henry
Center for Innovative Teaching and Learning
Indiana University Bloomington

From: samigo-team-bounces at collab.sakaiproject.org [mailto:samigo-team-bounces at collab.sakaiproject.org] On Behalf Of Regan, Alan
Sent: Monday, February 20, 2012 4:55 PM
To: samigo-team at collab.sakaiproject.org
Subject: [samigo-team] Feedback UI -- clarifying the dependencies

Dear Samigo team,

I really like the revisions being proposed on the Confluence site to help instructors configures assessments in Samigo.  I know they will make a big difference and really help instructors.

I would like to offer a suggestion regarding Feedback.  I noticed that there are some dependencies for some selections -- or at least some oddities if some are selected and others are not.  I hope in the new design, any dependencies will be visually communicated, such as graying out selections that require something else to be checked first.

Situation:
A professor claimed that students couldn't see feedback.  I took a look and noticed that he had only checked three of the feedback options: Question-Level Feedback, Selection-Level Feedback, and Grader's Comments.  That's it -- everything else was unchecked.  I've tried to provide a screenshot below -- not sure if it will come through in this listserv or not.

[cid:image001.png at 01CCF080.1771DD00]

In this situation on our Sakai 2.8 instance, none of the feedback was displaying to the student (except the overall comment field if someone entered a comment on the Scores screen for a student).

On nightly 2.9 Trunk instance (http://nightly2.sakaiproject.org:8082/portal/), I'm seeing something strange as well.  With the above selections in settings, the feedback seems to always display the incorrect feedback option, even if the student answered the question correctly.  (I just created it at 1:32 PM US Pacific today, Monday, February 20, 2012.)

It seems like there's a dependency happening that either "Student Response" or "Student's Question and Part Scores" must be selected in order for feedback to display or display properly.  "Correct Response" by itself doesn't work.  "Student's Assessment Scores" by itself doesn't work.  It's required that either "Student Response" or "Student's Question and Part Scores" is selected.  NOTE: Selecting "Student's Question and Part Scores" will turn on the student's response, even if "Student Response" is not selected, so that must be why it works.  I'm not sure if this is the desired behavior for this selection or not.

Anyway… if feedback does hinge on "student response," then I recommend making this dependency clear in the design, such as nesting the question, selection, and comments options below the "student response" option.  They should be grayed out until student response is selected, to prevent faculty confusion.

It might look something like this:

·         Student Response

o   Question-Level Feedback

o   Selection-Level Feedback

o   Grader's Comments

·         Correct Response

·         Student's Assessment Scores

·         Student's Question and Part Scores

·         Statistics and Histograms


NOTE: I cannot confirm the "Grader's Comments" feature since there's a bug in Trunk that prevents a "maintain" user from pulling up an individual student's scores -- ends in the bug report page.  I've re-created on nightly Trunk and nightly Experimental -- same problem.  In our local instance, grader comments would not display until at least "Student Response" was checked.  The bug in trunk is preventing confirmation -- sorry that I can't send absolute confirmation here.

I'd be happy to create a JIRA on either the design item, the "incorrect feedback" situation, or the current Scores bug -- just let me know what would be best here.

Thank you for considering this design item.

Sincerely,

Alan Regan, MFA
Manager, Technology and Learning
Information Technology
Pepperdine University
(310) 506-6756