[Assignments] Moderated Grading Options to Support the UK Higher Education Sector

Problem statement:

The way Moderation typically works in many (most?) UK universities is that: while the course may have multiple markers, each submission are marked by ONE marker - i.e., one submission is marked by one marker, though different submissions may be marked by different markers. The Moderator "reviews" a subset of the marked submissions - the job is to ensure consistency of marking across the board. The number of submissions in the subset is based on a particular formula, e.g., MAX(6,sqrt(total number of submissions)). The Moderator should pick a subset that is representative of a wide range of marks, as well as about-miss fails. The Moderator does not actually "mark" individual submissions, but rather prepares a report, with comments for the markers; the report includes the details of the marks distribution (of the whole batch of submissions as well as the subset moderated) - min, max, average, etc., list of submissions moderated, etc. Currently, Canvas does not enable this type of Moderation.

 

Proposed solution:

Canvas should tweak its Moderated Grading functionality to enable the UK HE type moderation. It is already possible to pick the number of markers as 1. Beyond that, if Canvas could generate the random subset of submissions that the Moderator should review and present that subset to the moderator, that would be helpful. Further, the Moderator shouldn't have to select or provide the mark IF the number of markers is 1.

Next, SpeedGrader for the Moderator should provide space for overall comments on each reviewed submission from the Moderator to the Marker - this is valuable irrespective of whether the UK system is used or not.

Finally, Canvas should generate the Moderation Report automatically by including the moderation statistics and compiling the Moderator's comments.

 

User role(s):

instructor

1 Comment
nathanatkinson
Community Team
Community Team
Status changed to: Open