cancel
Showing results for 
Search instead for 
Did you mean: 

New Quizzes should not *automatically* grade written responses

New Quizzes should not *automatically* grade written responses

(34)

Any questions that teachers have to manually grade (essay, short answer) are automatically calculated as zeros in Quizzes.Next. There are 2 major issues with this:

     1. Student's grades are completely inaccurate until the teacher grades them. This can cause serious issues like suspension from a sports team due to grades, consequences at home, and unneeded anxiety and stress. Yes, I can mute the assignment so they don't see that grade at home, but administrators who are determining eligibility see it as part of the average. 

     2. Because Quizzes.Next considers this question already graded, as a teacher, I have no way of telling which responses I have graded and which I have not.  In the old Quiz system, it shows a document symbol in the gradebook and a little orange dot next to their name in Speedgrader to show that these questions still need to be graded.  When you are look at a specific student's quiz in Speed grader, it tells you what still needs to be graded, but still shows a check next to their name in the list, so you have to scroll through every student to see if it has been graded. With hundreds of students turning in assignments at different times this is not helpful.

Considering the old version has this, this is something that should have been fixed before it ever came out of Beta. It is a serious glitch in how Quizzes.Next interacts with the Canvas Gradebook. 

42 Comments
kroeninm
Explorer II

Yes, thankfully the student view does show that items need grading.  Right now I see that:

  • The Quizzes.Next quizzes do not appear in the instructor ToDo list when questions need manually graded.  
  • When the instructor views grading columns in the Grades page they look fully graded.
  • When the instructor views the student list within Speedgrader, they look fully graded.

The only way for the instructor or TA to know that questions need manually graded is to manually review each speedgrader item for all students until they are fully graded.  For instructors that take over existing courses or TAs they may not know which quizzes have questions needing manual grades so it's a lot of extra work.  

Student View and the details page for each quiz in Speedgrader correctly reflect they are not yet graded though. So the most important view (students) is there. 

310007_ToGrade.png

Melanie

jennifer_files
Surveyor

It would be nice to have essay questions that are ungraded to be marked as such in the Speedgrader until they are assigned points by the instructor. In the old Quiz feature ungraded tests (that had essay questions) were given an orange dot until they were reviewed and assigned points by the instructor. After being graded they were marked with a green check. As an instructor I was able to see the ones that had been reviewed and the ones that had not. This was especially beneficial when I had to leave in the middle of grading and come back later. I could see precisely which student I left off on. This would make life easier for teachers

jennifer_files
Surveyor

I agree totally, not having this in Quizzes.Next makes it harder.

juliekaras
Surveyor

I agree with this.

Thought I would post my little hack for this so that our trainers can clearly see which ones need marking and which ones have already been marked but need a retake. This would be visible in the Grades/Marks section of the course.

I created a grading scheme specifically for my quizzes.next essay type assessments - our short answer response assessments. There is a flaw in that if a student doesn't get any questions correct when a trainer marks it that it will still say awaiting marking in the grades section but this hasn't happened as yet thankfully! I guess you can weigh up if that is likely with your students or not.

But it may assist your trainers... 🙂

Quizzes Next Essay Grading Scheme

315711_Grades - awaiting marking.PNG

kroeninm
Explorer II

Well done, I can see this working in some cases.  Brilliant!!!

Melanie

rmurchshafer
Community Coach
Community Coach

 @juliekaras ‌ Thanks for posting the grade scale idea; this will be helpful especially for long running courses where a quiz may get taken and need grading over the course of several months and years.  It's very annoying that Quizzes.NEXT submissions do not show up in a teachers To Do list when something needs to be graded, and more annoying that the product manager stated in posts that it may never be since Q.Next was developed as an LTI tool instead of directly in Canvas.  I think this is a major oversight when it was decided to create this tool.  

Rick

kassiea_calvo
Community Member

Considering the old version has this, this is something that should have been fixed before it ever came out of Beta. It is a serious glitch in how Quizzes.Next interacts with the Canvas Gradebook. 

Could not agree more with this. Please fix this! 

jennifer_files
Surveyor

Do you know if this will be fixed any time soon?

kroeninm
Explorer II

It's tied to the way LTI works, none of the 3rd party tools that I know of can tie into the Todo / reminder / grading list but hopefully it's something on Canvas's roadmap as it's a pretty large issue when you use essay questions and have large enrollment classes which I know many institutions have.  

I haven't heard of any upcoming fixes though yet  @jennifer_files ‌ but it's definitely on my top 5 list of things needed before we do any large migration/implementation...


Melanie

timothy_maw
Adventurer

Yes please, we need this. Too many student are alarmed when it looks like they did horrible on a test because things appear to be graded when they haven't been yet.

jennifer_files
Surveyor

Exactly!! My middle schoolers freak out every time. And then I have to remind them I have to go back and give them points back.

kirsten_ryall
Explorer III

Hi there, this still appears to be an outstanding issue with manual-type questions. Has there been any progress? Kirsten

jennifervinson
Surveyor

This a great idea however I can't get that to show up on mine for some reason Smiley Sad

Nancy_Webb_CCSF
Adventurer

As a corollary to Quizzes.Next considers this question already graded, it seems a 100% essay question quiz shows a student that they've scored 0 points at the end of the quiz. Yes it also shows the number of questions that need review, but in the gradebook it just shows 0. This is not good for students!   In the classic gradebook, it shows an icon indicating it needs grading rather than a score, much better.  If its a quiz with mixed question types, they might see a very low score and think that's the final score.

Work around: make sure all new quizzes are set to manual posting of grades, and don't post until they are all scored.  But that shouldn't be necessary.  Maybe there's an idea about this gradebook problem, although it may take an LTI  update before something can be done. Am I right?

paul14
Surveyor II

We're struggling with this issue too.

Students, on submission, are getting notifications that their assignment has been graded.

They get excited, jump in and check their marks and see it as incomplete. Then they inevitably either:

  • Call or email and ask what they did wrong
  • Try to resubmit the activity again (and again!)

It's a bit frustrating and time-wasting for both students and our team.

Has there been any progress on a fix for this?

raehale
Surveyor II

I very much would like to see this issue addressed by Canvas. Students are constantly worried about grades and this is a huge problem. This means that it will not only show incorrect grades, but that we are not notified of the submission to be able to manually fix the grade and must check continuously to fix it. 

This needs to be fixed asap. 

bourjaim
Surveyor II

The fact that this has not been fixed yet is obscene.  Now that most schools are teaching remotely, this sort of problem is being magnified tenfold.  I'm going to start looking for a new option for my school.

sschuler
Surveyor II

I gave my first online quiz last month. The quiz consisted of just a few short-answer questions, for which I used the "Essay Question" feature.  Imagine my students' horror when, as soon as they submitted their quizzes, their grade displayed as -0-. As you can imagine, I spent a bit of time calming my students' nerves.  But with every quiz that contains an essay question, their grade drops because the ungraded questions default to 0.

"Classic Quizzes" didn't have this problem.  When students answer an essay question in "Classic Quizzes," the default grade is "ungraded," not zero.  This feature should be carried over into New Quizzes.

After some online searching, it seems that other kinds of instructor-graded questions may also have this problem. 

flee1
Surveyor II

Agree with the OP and other commenters here. Additionally, the auto-grading will effect the student's total grave even though the quiz is not fully graded. I know that on the student's end the grades are hidden (if you set that option), however on my end it shows. This is very misleading for many reasons.

It would be nice if New Quizzes functions similarly to Classic quizzes in regards to posting grades. I realize this might not happen because New Quizzes is basically an LTI currently, and therefore does not talk to SpeedGrader/Canvas in the same manner. But it is my understanding that New Quizzes will eventually become to only option available and replace Classic. At that point, these grading considerations need to be put in place for when that happens.

cbaker3
Surveyor

I am so mad, I am actually shaking: https://twitter.com/bakerhhhs/status/1312766790896881666?s=20