Identifying and Correcting Problematic New Quiz Questions in All Sections of Canvas Blueprints
Our institution contains multiple campuses and utilizes Canvas Blueprints to ensure course consistency. When piloting new course curricula, we often need to identify problematic questions in Canvas quizzes/exams. While Canvas has statistics for quizzes in individual sections, Canvas does not have the ability to perform assessment statics across all blueprint sections at once. We want to understand the impact of our curriculum modifications across all sections of a specific blueprinted course, on a term-by-term basis.
Next, suppose we identify a problematic question. Perhaps 75% (or some user-defined threshold) of all students across all sections missed a specific exam/quiz question. It would be advantageous for us to remove such identified problematic questions from question banks in all sections of the blueprint, while simultaneously updating/correcting the scores of all students even in situations for which those students receive a random sample of questions from the banks. In other words, if student A received 3 of the problematic questions, and student B received only 1 in, say, the first exam, the appropriate questions would be automatically removed, and the scores updated, automatically. Currently, assuming such a problematic question is identified, an instructor must manually go through each student's exams, find, and remove those problematic questions (according to a list of problematic questions identified from a previous manual inspection), and then at the end of it all, manually regrade that student's exam/quiz since Canvas also cannot regrade a quiz following the removal of a question (regrade only appears to work if an answer choice is changed).
I hope the request makes sense. If you have any additional questions, please share. I am happy to help in any way I can.
-matt
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
