cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Assigning Grades for Peer Reviews

Assigning Grades for Peer Reviews

(22)
Part of participating in online coursework involves working with other students to improve drafts and engage in the learning community. When students are assigned peer reviews, let's be honest, they aren't motivated to complete it unless there is a grade attached. I would love the ability to grade peer reviews.

 

This could be as simple as complete/incomplete, or more complex where the completion of peer reviews was part of a grading rubric for the assignment. But it would be nice if there was something in the grade book, some academic weight given to participating in these reviews, that doesn't involve manually looking up peer reviews outside of the grade book.

82 Comments
ewander
Community Contributor

I agree with this. I would love to get the chance to give my students a grade when they have or have not done the peer review. I currently have a student who has not done his peer review and, like you said, has no motivation to complete it. I have told him I will not grade his entire assignment until he can done the peer review but to no avail.

Thank you for the suggestion!

Erin

jsimpson1
Community Member

I am trying to set up an assignment where the students have to review group PowerPoint presentations and fill out a feedback form to the groups.  I would not only like to be able to assign points for them to fill out the feedback forms, but also set a due date.

james_umphres
Community Participant

I'm surprised this isn't already a feature. I know of at least one instructor who creates another "no submissions" assignment just so she can assign grades for the peer review. As you can imagine, this creates a bit of a disconnect... And it sounds pretty tedious to me.

mfreund
Community Participant

Agreed. This is closely related to a feature suggestion I recently put in, to have a deadline for completing the peer review.

!Please consider voting it up too!

mhovde
Community Member

I agree with this suggestion, but until this feature is added to Canvas, I have devised a way for giving a grade for completing peer reviews.  Submitting is worth 10 points and reviewing is worth 10 points.  I have to view the list of completed peer reviews to grade the latter, but it's worth the few minutes it takes to do so.

10618071
Community Participant

I see this as a key feature in effective peer review.

In the spirit of "skating to where the puck is going to be", please take note that other platforms that have been doing this for years are recognizing the need for asynchronous peer review and are working in that direction.

As you build your platform please consider asynchronous work flows as well. I have written proposals that are being used by other LMSs and would love to freely share them with Canvas. In a world of Moocs, corporate training, competency based training, quest based training, choose your own adventure style training, and cafeteria style training, it is no longer reasonable to assume that students will be in the same place in the course as all other students. We must accommodate a variety of paths and speeds through content while at the same time allowing for social interaction and engagement in learning.

Renee_Carney
Community Team
Community Team

​ has been redirected to this thread.  If you voted on the previous feature but have not voted here yet, please do.

Here are the notes from the linked Idea:

 @mfreund ​

I often have students do peer reviews of one another's work, and I require both submission of their own work and a review of their classmates' within a specified period of several days.

At present it is only possible to award a grade for submitting (and being scored on) their own work. There is no way to enforce the activity of reviewing classmates' work by assigning a grade or points when they complete it.

It would be great if the peer review itself could be set up as a graded assignment with its own distinct deadline and grade point weighting. Ideally, it could be set up so that the grade for the review could either be automatic upon submission of their comments, or else graded by the instructor in case the instructor feels it is necessary to ensure a certain quality standard for the feedback they provide their peer.

mhovde

I agree with this suggestion, but until this feature is added to Canvas, I have devised a way for giving a grade for completing peer reviews.  Submitting is worth 10 points and reviewing is worth 10 points.  I have to view the list of completed peer reviews to grade the latter, but it's worth the few minutes it takes to do so.

 @blong ​

oh please oh please add this!  The lack of this ability is one of the reasons I recommend my faculty NOT use peer reviews.  The work around I've given them for grading purposes is to either 1) create an assignment item that has no submission and store the points there or 2) create it as an item in the rubric for that assignment.  They aren't happy with the work around but it's something for the time being.

 @christine_mckeo ​

Yes! We've been hearing from some of our schools that this is a much needed feature!

10618071

I see this as a key feature in effective peer review.

In the spirit of "skating to where the puck is going to be", please take note that other platforms that have been doing this for years are recognizing the need for asynchronous peer review and are working in that direction.

As you build your platform please consider asynchronous work flows as well. I have written proposals that are being used by other LMSs and would love to freely share them with Canvas. In a world of Moocs, corporate training, competency based training, quest based training, choose your own adventure style training, and cafeteria style training, it is no longer reasonable to assume that students will be in the same place in the course as all other students. We must accommodate a variety of paths and speeds through content while at the same time allowing for social interaction and engagement in learning.

 @lhughes ​

Absolutely! I've lamented the need for this since I first started using Peer Review!

10618071
Community Participant

There are a variety of strategies for how points are distributed.

One method is to give a participation grade proportional to the number of assignments completed.

Another is to compare scores of all reviewers, consider the most common score "correct" and give other reviews a score based on how similar they are

I use the first most often. The second can have odd results.

I think it might also be nice to have an average score from the reviewees factor into the reviewer's score based on the quality of the feedback.

Research has shown no correlation between the score received by the reviwee and the return evaluation score given the reviewer, showing little risk of punitive scoring.

christine_mckeo
Community Participant

I am not (honestly! Smiley Happy) trying to be pushy, but I have noticed that this idea has been in the top 2 or 3 for at least now. According to the voting documentation, "Each week, the Product team will take on the ten highest-voted ideas to which they haven't yet responded" -- is there a "release schedule" for these kinds of responses from Instructure? I know there are lots of ideas to sort through and that a response probably takes some coordination - just wondering!

Renee_Carney
Community Team
Community Team

 @christine_mckeo ​

Thank you so much for your comment/questions.

The voting documentation does state that, along with the need for an idea to hit 100 votes.  This idea has not yet hit 100 votes.  In the past we were addressing ideas that had less than 100 votes to practice our processes.  The top 10 is so that if we have 20+ ideas hit over 100 votes in one week we are not asking our awesome Product Managers to sacrifice the amazing work they do to move features forward in order to comment on the community.  I hope this explanation helps.

christine_mckeo
Community Participant

Thanks for the response,  @Renee_Carney ​! Forgive me for saying so, but I think if that's the case the documentation on the voting process page could benefit from a little clarification. Yes, the documentation says an idea will be archived after 3 months if it hasn't gotten 100 votes, but it does not specify that an idea *needs* 100 votes in order to move to the next stage. I actually assumed the "Top 10" distinction had replaced the "number of votes" distinction because I saw many ideas had moved into the "Gathering Info" stage before hitting 100 (I now know why, thanks to your comment). I also notice that of all the ideas that are "Open for Voting", only one has (barely) reached 100 votes -- . Does that mean it's possible that we'll only receive a response to this one idea?

Tagging the  @jivedocs_unfede ​ so they can see this feedback re: the voting process documentation.

ccalderon
Community Champion

The 3 month deadline for this Idea is rapidly approaching and according to the new voting rules, it will be Archived because it hasn't reached the 100 vote level. We can't let that happen. Let's get all of our peers to vote. I am asking my co-workers now to log in and vote this up if they have not. We only need 12 votes let's do it!!

christine_mckeo
Community Participant

I've done the same! Go,  @ccalderon ​!!

ccalderon
Community Champion

2 more votes to go - c'mon everyone!!

canvas_admin
Community Champion

100   BOOM!

ccalderon
Community Champion

Yay!!!!

we did it.jpg

christine_mckeo
Community Participant

Great Success!!

Now people should go vote here: " modifiedtitle="true" title="Make a file read-only but Not Downloadable in Canvas​ :smileygrin: :smileycool: :smileysilly:

allison
Instructure
Instructure

Hello all,

Thank you so much for your enthusiasm around Peer Review. In the last few months, I have conducted multiple interviews and learned a great deal about what people want. I've started outlining what we might consider to take Peer Review to the next level. We're still in discovery phase, but I wanted to share with you where we are today and ask for your feedback. If any of you are interested in looking more closely at this or sharing some of your specific needs, please message or email me. I'd be happy to set up a phone call to learn more.

So far, this is what we have:

1. Allow students to submit individual work, even if they are part of a group. (Currently, group assignments allow for one submission only, made in behalf of the entire group.)

2. Support the swapping of individual submissions within groups and across groups. If swapping individual submissions across groups, make sure that students do not evaluate members of their own group. Improve support for swapping a single group deliverable (i.e. live presentation, slide deck, or video) across groups.

3. Allow instructors to distribute and adjust peer review assignments before notifying students. Notifications can be sent out manually or at a specific date and time.

4. Support a three-assignment workflow (Assignment 1: rough draft submission, Assignment 2: peer review/review the reviewer, Assignment 3: final submission). Assignment 2 would link to the submissions of Assignment 1.

Item 4 should address the specific request on this thread. To elaborate further, students would see Assignment 2 in the Syllabus, Calendar, Dashboard+Notifications, and as a separate column in the gradebook. Instructors would be able to attach separate rubrics and grades for all three assignments: one for the draft submission, one for evaluating the quality of a student's reviews, and another for the final submission.

Other possibilities:

  • When grading Assignment 1 in the SpeedGrader, instructors would be able to easily see assignment peer feedback (from Assignment 2) and take that into consideration when giving a student a grade on their rough draft.
  • When grading Assignment 2 in SpeedGrader, instructors would be able to easily see the reviews that a student gave and take that into consideration when grading students on the quality of their evaluation.
  • Assignment 3 would be an optional stand-alone assignment that instructors could set up for the submission of final drafts.

The four enhancements listed above seem to address the core use cases I've heard about so far. We still have to validate this, however, which is why I would love your feedback about whether or not these improvements would meet the Peer Review needs you see at your organizations.

I can't commit to a specific time when we will execute on these ideas, but please know that I am actively preparing this project for our roadmap discussions.

Keep your votes and feedback coming! It's awesome to see all of this support for Peer Review.

lpturi
Community Member

I need to give a grade for students peer reviewing or answering to discussion threads.

ccalderon
Community Champion

Allison - Thanks so much for this recap and your attention to detail. What you have laid out is very clear and would appear to meet our needs.

P.S. - While the fact-gathering is going on, please note we are still waiting on anonymity of the current Peer Review process to be fixed...the notifications to students include the name of the reviewer, which makes the current feature unusable.

Thank you!!

About Idea Conversations
In the Instructure Community Ideas space, you can share, converse, and rate idea conversations related to software improvements to Instructure products.