cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Multiple Answer quiz question - partial points without penalty

Multiple Answer quiz question - partial points without penalty

(2)
Currently the way partial points in a multiple answer quiz question works is to dock points for incorrect answers.  This is necessary, otherwise one could just select every choice and get full points.

 

But some faculty would like to give points for each correct answer without penalizing for incorrect choices.  This could be done if the number of choices became limited to the total number of correct answers.

 

So this feature idea is to add an option to the multiple answer question type that would limit the number of possible choices  a student could select to the total number of correct answers and allow for full partial points without subtracting points for an incorrect guess.

This idea has been developed and deployed to Canvas

For details, please read through the Canvas Release Notes (2020-04-18)

36 Comments
peter_meulenbro
Community Member

You need to be logged in to vote on this. If you would like to vote on this but don't see the option. Please see if you are logged in.

tingting_lu
Community Member

Or better yet, allow the instructor to customize the grading scheme and choose the percentage of points to take away for the wrong answers. I think some more user control here would benefit experienced users who know what they are doing, and use such power with caution.

AJC17246
Community Participant

One approach I've suggested for these questions in the past would be to simply treat them as a set of true/false questions. If you have a multiple answer question with n possible answers and worth X points, then each answer is worth X/n points and you get those points if you make the correct choice for that answer. That way both ways of getting an answer incorrect (selecting one that's wrong or not selecting one that's right) are weighted equally.

jsparks
Instructure
Instructure

Hello, Canvas Family!

We want to implement partial credit across all of the item types quizzes tool.  We are exploring a series of extensive improvements to the quizzes toolset, which includes this idea and much more. I know we won't be able to deploy this idea in the next six months; however, be assured we've listened and want to implement this in the not-too-distant future.

Kind regards,

Jason

Renee_Carney
Community Team
Community Team

Thank you for the exciting news Jason.

Community members can follow the larger project at Modern Quizzing Engine

jmscheff
Community Member

This is exactly what I would like as well. I would like to treat each option individually and keep points awarded at whole numbers. As it is now, a mistake becomes increasingly more costly as fewer correct options are made available as the available points are divided among the incorrect answers. Students should not only be rewarded for correctly marking true answers but not marking false answers.

ryeckman
Community Participant

I'm happy to hear this is being developed.  I just posted almost the exact same idea since this one is closed to voting.  Allow instructors to select between the two industry standards for scoring these types of questions - all or nothing, vs. X/n partial credit for NOT selecting distractors.  What I feel needs to be address more immediately is that the current scoring system is NOT an industry standard and makes it difficult for institutions who are creating online courses for certifications.  We're setting ourselves up for backlash from certification candidates once they realize that their certification exams are not scored in a legitimate way.  This needs to be fixed pronto.

kbarth
Community Participant

We currently use D2L (switching to Canvas), but we can give partial % points on Multiple choice answers. For example, a question has 4 answers, 2 are only partially correct (we give 50% for either) or one answer that is essentially A & B is correct for which we give 100%. Can this be done in Canvas? If not, is it on the horizon? Not all questions have just 1 possible answer, or 1 complete answer.

Thanks for any guidance/suggestions on how to make this happen in my course.

jsparks
Instructure
Instructure

On the horizon!

download.jpeg

kona
Community Coach
Community Coach

How on the horizon? Like 2016 on the horizon? Smiley Happy

jsparks
Instructure
Instructure

A part of the Canvas Studio: Modern Quizzing Engine​ project...  full credit, partial credit, no credit, negative credit.

kona
Community Coach
Community Coach

That will make a LOT of people pretty happy!

cohenf
Community Participant

I upvoted here. Also, I posted something "Multiple Answers" related in "Ideas" but it is "on hold" while Instructure revises the idea submission process. It is a formula that addresses the flaw (from my perspective) in the way partial credit is currently calculated for multiple answers, that flaw being that the number of incorrect options, no matter how many or how few there are, is not accounted for in gauging the difficulty of the question and, therefore, in gauging how challenging the question is for the student. Rather than copy and paste everything, I'm providing the link to my formula here.

Renee_Carney
Community Team
Community Team

This idea was moved from Under Consideration stage (no longer in use) to the Product Radar stage.  

This change was made as part of a feature idea process evolution.  Find more information, and contribute insights, by joining Focus Group: DRAFT Feature Idea Space

larkek
Community Member

I teach in a nursing program. We do NOT allow partial credit because the licensing exam for nursing does not give partial credit and we want students to get used to reading the choices and applying or analyzing the information in the answer VERY carefully before selecting it as correct.

I would like to see, as was stated above, "Allow instructors to select between the two industry standards for scoring these types of questions - all or nothing."

It is incredibly burdensome to go into each students test, find the partial credit and change it to zero points. 

PLEASE consider this request SOON!

kbarth
Community Participant

I agree as we have a Nursing program, and other external accredited programs as well.

maperrinsmith
Community Member

I think this would be an awesome idea. That way a student can see the parts he/she got right without getting a zero "0" for the entire question. 

stacy_shipway
Community Member

Our nursing program and allied health also needs  for you to allow instructors to select between the two industry standards for scoring these types of questions - all or nothing. it is very tedious to hand score these questions to be consistent with the rigor of the national exam.  Please attend to this quickly.

hema_lalwani
Community Member

This is a great idea. I believe that getting a "0" demotivates the students and sometimes it shuts them down completely. This will be a great feature where students can see and work on the parts that they really need help on.

ryeckman
Community Participant

It's disparaging to see that I posted a comment about this over two years ago and nothing has been done to fix the issue.  Canvas does not meet the industry standard.  For those of us offering national certifications, this is a serious issue that needs to be dealt with.  You have two options--and both need to be made available:

1) All or nothing scoring.  Either the student gets the answer exactly correct and gets full credit, or the student picks distractors and gets no credit.

2) 1/n scoring. Each potential answer (n) is worth 1/n points.  There are NO negative points.  Students receive 1/n point for correctly selecting correct answers as well as receiving 1/n points for correctly NOT selecting distractors.  So, for example, if a question had 4 potential answers, the correct ones being A, B, and D, and a student selected A and D, the student would receive 3/4 or 0.75 points for correctly selecting A and D, as well as correctly NOT selecting C.

Neither of the above industry standards are what the current Canvas quizzing software allows and it is HIGHLY problematic.  It opens the door for candidates of national certifications to contest their results.  We have to rescore every test we administer by hand in order to compensate for the issue--which begs the question of why we use this management system at all.  Please take this more seriously and prioritize it!

About Idea Conversations
In the Instructure Community Ideas space, you can share, converse, and rate idea conversations related to software improvements to Instructure products.