Show Only Incorrectly Answered Questions with Correct Response (while running Honorlock)

[jelarv]

I'm challenged in using Canvas' new quiz module in terms of providing students feedback but not access to all the quiz questions.

In my environment, after students take a quiz (I proctor weekly quizzes in class while students use their laptops), I would like to show them only the questions they answered incorrectly with the correct answers, all while remaining in Honorlock, so I can see if they're taking screenshots of the questions, but I'm told this isn't possible.  I'm new to Canvas and in the past used D2L with Respondus Lockdown Browser, which allowed me to do so quite easily, but I cannot find a similar solution with Canvas/Honorlock.

From an instructional design perspective, I think we would all agree it's imperative to show students what they did wrong and why.  However, I don't want students to see the questions they answered correctly, as it increases the likelihood that they will screen capture the questions and post them on the Internet for other students to use for cheating.  One suggested solution I received that will not work for me would be to debrief the quiz afterwards, but I use quiz pools so a 10-question quiz could be drawn from as many as 30 questions, which is too much content to cover after each week's quiz.

As background, pre-COVID, I had over 1,000 custom quiz questions in my quiz banks that I had to rebuild after COVID because my industrious students posted them on the Internet when they were being assessed remotely.  We're back in the classroom which provides more control, but students still have their laptops where they can screen capture the quizzes when using Honorlock because it apparently doesn't record anything after the quiz ends (Respondus would stay active until the student exited D2L's quiz module so they couldn't use a screen capture app...and I  proctor so they can't pull out their phones and take photos).

I would greatly appreciate a solution, as the Canvas/Honorlock option I currently see, will likely lead to me spending a few weeks every summer rebuilding my question banks, since students will have the ability to screen capture all their quiz questions after each quiz (assuming I want them to see which ones they answered incorrectly).

[mzimmerman · Accepted solution]

Hi @jelarv 

The options of what specific feedback can be provided to students after they have submitted a quiz is an LMS (Canvas, D2L) function, not really related to Respondus or Honorlock.

While D2L may have different feedback options, in Canvas, the options are to show all questions, or not to show questions at all.  

In "classic" quizzes, when you show the questions, students can also see their answers, and whether or not those answers are correct.  You have the option to display the correct answers after a certain date.

In "New Quizzes", if you show the questions, you have the option of whether or not to show the student's answers, to show whether the answer is correct or not, to show the correct answer after a certain date, and to display other feedback.

There is not an option to only display questions that were answered incorrectly in either quiz type.

[jelarv]

Thanks!  To clarify, at my end, I understand the lockdown applications don't offer options on what to show students, but rather I was trying to highlight that with RLB, the answers are displayed while locked down (this was my experience when using D2L), whereas this is not the case when using Honorlock with Canvas, thus exposing my question banks to being copied and subsequently appearing on the Internet.  The only way I can show students their incorrectly answered questions in Canvas is to show them ALL the questions and answers, thus exposing even more of my questions when using Honorlock.

It's unfortunate (and disappointing) that Canvas doesn't offer the option to show only those marked wrong.  From an instructional design perspective, I don't see why an average student would take the time to review the questions they marked correctly (clearly, they understand the content if they answered correctly).  For my needs, this single feature is more important than all of the other question display options combined (for what it's worth, D2L, Blackboard, and Atomic Assessments all offer this option which suggests it's something their software designers identified when conducting UX/UI testing.)  For what it's worth, this has been a request from others using Canvas going back 9 years:  https://community.canvaslms.com/t5/Archived-Questions/ARCHIVED-Is-there-a-way-to-only-show-students-...

[VPundir]

I understand and appreciate the issue you have highlighted.

However, it is tough not to disagree with this statement:

---

@jelarv wrote:

From an instructional design perspective, I don't see why an average student would take the time to review the questions they marked correctly (clearly, they understand the content if they answered correctly).  

---

From a pedagogical perspective, there is value to reviewing what you have done correctly; further, marking an correctly does not necessarily mean they have the correct concept or understanding - it may have been a lucky guess, or they may have really struggled with it.

[jelarv]

You have a very valid point VPUndir!