External Tools that allow multiple graders?

[JonathanSmucker]

My program conducts regular student evaluations using a panel of graders. We have moved our comments to mostly typed/online and are looking to streamline this process. Moderated Grading through canvas does not quite meet our needs. 

Are there any external tools that can run on Canvas that will help us achieve-

REQUIRED ELEMENTS

allow multiple graders on a single submission

show students all grades and comments

OPTIONAL ELEMENTS

allow grading on a rubric

average and pass through scoring to Canvas (highly preferred)

produce a document/report of comments and grades

Thank you 

[greydon]

Hello @JonathanSmucker 

Thank you for contacting the Instructure Community. I am pretty familiar with many of the LTIs that are offered through Canvas and I don't believe there is one that meets your needs. Being able to grade and comment and view is usually tied to permissions or assignment settings. For example, TAs and teachers can obviously leave grades for students. If you enable peer reviews, then students can grade each other as well. Students can use rubrics if you enable peer reviews - but you probably don't want this as it will require them to review one or all students depending on your settings. You could consider an open discussion for all the students so they can review each other's work, leave comments, etc. You can make that discussion graded or have a separate mock assignment to actually enter grades  based on their  participation. Some teachers also just use Google to achieve more of a collaborative process like this while again mocking a mock-up assignment to actually give the students scores. 

Much of what you need is tied to permissions and there is not necessarily and app that will override all of that and is as customizable as you need. I know this isn't the information you are looking for but hopefully it is helpful. Perhaps other people out there have found other useful work arounds - but this will be difficult to achieve with a single external tool and you may need to incorporate a few different options to achieve what you need. 

[wyelearning]

Hiya,

I'm not aware of an LTI tool that supports this, but it's perfectly possibly to develop. An LTI 1.3 integration into assignments that allowed the student to submit could then allow marking by more than one grader (along with comments) then could pass back the average response back to Canvas.

Doing this as an LTI would mean the submission would be held by the LTI tool (the student submitted files/text), when being marked this would also be done through the LTI tool (so no Canvas speedgrader unless something similar was developed in the LTI) and then once marked the results could be posted back to Canvas through the assignments and grades service (https://www.imsglobal.org/spec/lti-ags/v2p0).

So it's all possible.

Matthew