cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Export aggregate rubric scores to identify strengths and weaknesses of class as a whole

Export aggregate rubric scores to identify strengths and weaknesses of class as a whole

(34)
I'd like Canvas to be able to generate a single table that shows the rubric line item scores for all students.  Then I would easily be able to tell which items students struggled most with, and plan subsequent lessons accordingly.
53 Comments
ronmarx
Community Contributor

In pedagogical practice, I also recommend voting up similar and related ideas:Text Conversion to QTI for Bulk Question Import and Create a Secondary Rubric Structure to Conform with Conventions. I also echo the sentiments of Kelsey Rodgers.

abasche2
Community Member

I would strongly encourage Canvas to add this feature. It would provide valuable analytics to understand student performance in particular aspects of rubrics. I am working on a portfolio project to summarize student learning for a particular aspect of my course and this feature would be hugely helpful. I am disappointed that it is not something already available in Canvas given the other strong performance analytics available.

vmurphy3
Community Member

This seems to me an essential need for any teacher working to see growth in their student performance and mastery of concepts. It would allow instructors to see where their students are struggling and need more help and where they are excelling so that they can move on. In terms of assessment, this can also be crucial for instructors to demonstrate their success in teaching.

Jeff_F
Community Champion

For rubrics, our wish list is to be able to report on the following:

  1. Does an assignment have a rubric associated with it?
  2. Was the rubric completed by the instructor for a submission?
  3. How many submissions have a completed rubric (a calculated field derived from the number of graded submissions)
  4. Aggregation of rubric scoring - how many students and percentage of students scored at each performance level for each criterion?  **  (Basically this idea above)
  5. Listing of rubric comments for each criterion

In addition to the above mentioned aggregate view within a course for the instructor, we would like to use Canvas Data to extract this data so it can be aggregated across courses/ instructors/ terms.

James
Community Champion

 @Jeff_F , thanks for responding to this. I was looking for a thread about what people wanted in a rubric export and had lost it (and courses started so I had to get busy on those) and this brought it back to my inbox so I could find it.

For your question 2, is the emphasis on "completed" or "instructor"? Are you wanting to identify peer reviews with that item?

Background: I wrote a Tampermonkey userscript a couple of weeks ago that adds an export button to the rubrics.

321819_pastedImage_2.png

I was working in the dark as to how people would really want to use it. Right now, it exports everything in a database-type layout (one row for each student / criterion combination) and also as a summary like a pivot table (one row per student and one column per criterion). I also wanted to write the code to export the rubric itself so that it could be brought back into Canvas with the rubric importer I wrote, but I need to finish that and change the rubric importer to support the long descriptions. Anyway, I found a JavaScript library that would create an Excel file, so it puts each of those on its own sheet within the workbook. As I was writing, I was trying to keep in mind the ability to automate using Node JS, but I was under time constraints and something had to give way so I could get it done.

Jeff_F
Community Champion

Hello James - for #2 the importance is on completed.  I am good with assuming the instructor is the person performing the grading.   We do not currently have interest in the peer review feature.

The ability to download the results to file would be much more efficient than the current practice of looking at each submission rubric individually..  Ultimately we'd like to see rubric results within Canvas Data as there are hundreds of courses each term (often times +700) and we have 12 terms per year.  

brett_ford
Community Member

This is fantastic. I think the key use is exactly what you describe: each student is a row, each item in the rubric is a column (plus columns for any text comments).  Will this feature be available soon?

Thank you!
Brett 

James
Community Champion

Soon is a relative term. I've had most of it done since early August but have not worked on it since then. Finding time and motivation to finish it is the challenge.

brett_ford
Community Member

It must be hard to prioritize all the requests you're getting, I totally get it. I do know that there are many educators out there (myself included) who would be very grateful for your time because they would use this tool right away. I know I would!

rgong1
Community Participant

This would be such a valuable feature for me. As I am not the one doing the grading and I have large classes, I cannot easily tell where students are having issues and address those in class. To be able to download the rubric data from all students would be very helpful for assessment and closing the loop on places students are having issues. 

lauren_sayer
Community Contributor

We use rubrics to measure learning dispositions or behaviours.  Having the ability to do this would enable us to have strong discussions regarding pastoral care 

lynchj12
Community Member

Thanks for this tip! It may be the perfect solution for me. Smiley Happy Can I go to the workshop? 

JamesAshby
Community Contributor

Hi everyone. If it helps, I created a browser enhancement driven by TamperMonkey that lets you export all criterion scores for all students in a single assignment from within Speedgrader. Check out the install guide and let me know if you have any feedback: Export Rubric Scores.

rgong1
Community Participant

This is perfect! Exactly what I needed. Thanks so much!

bernhard_lohkam
Community Participant

This is a very important feature which I fully support! I just want to iterate that not just the total score of the rubric is useful but the rubric ratings for each criteria per student. Not just for analytis but for e.g. for minimum requirements on specific criteria as well.

Bernhard

wschilling
Community Member

This feature is absolutely essential to have to make rubrics useful.  If I can not look overall at how my students are doing on each part that I grade for an assignment in a quantifiable way, how can I continuously improve on the assignment?  This is not a tremendously difficult feature to implement either.  I'm honestly amazed that this was proposed 5 years ago and still has not been built.

tajaco
Community Member

Totally agree. How is it possible that this is not yet implemented?? Is absolutely basic and essential to evaluating students and class as a teacher.

l_balko
Community Member

There is an essential need for faculty to evaluate individual question response data by each student. Access to question response data is currently available for Classic quizzes, but not New Quizzes. Lack of access to these data limits the ability to evaluate the quiz/exam results effectively. It translates to Correct/Incorrect and not which misconceptions are shared by students or whether a question was well written. Please support the request started in 2015 to provide question response data for ALL Canvas assessments, including New Quizzes.

a1224143
Community Participant

We are using Rubrics with Peer Assessment more and more as we move toward more use of dialogic pedagogy. A feature that would at least allow exporting rubric reviews by students would save our teacher academics alot of time and reduce the mistakes made when moderating scores.

TRACYLT
Community Member

For over 5 years, users have been saying that not being able to download scores from rubrics - only totals- interferes with the usefulness of using rubrics to assess how well students are understanding different aspects of materials.  Analyzing the data requires copying it by hand to a spreadsheet or doing the computer programming yourself.  It seems like this would be reasonable to fix (since some computer savvy users have written code to do this, it seems like someone at Canvas should have the ability too).  You can download quizzes getting scores for each question instead of just an overall score.  Could you piggy back onto that functionality?

If no one at Canvas can figure it out, maybe you need to hire someone who can?