Quiz statistics are only valid for quizzes under 100 questions or 1000 attempts

[heidi1]

Why is this and how do I explain this to my faculty?  "You can view quiz statistics for quizzes that have been published and have at least one submission. Quiz statistics are only valid for quizzes under 100 questions or 1000 attempts. For instance, a quiz with 200 questions will not generate quiz statistics. However, a quiz with 75 questions will generate quiz statistics until the quiz has reached 1000 attempts."

Thanks,

Heidi

[mlewis23]

Heidi,

Thanks, this is very helpful.  I hadn't seen that write up before. I too have had to try and explain some of these issues to faculty.  The only thing I could come up with was there is a limit with the amount of server resources that Canvas is willing to provide.

[heidi1]

I don't know that this will actually end up being an issue as our larger classes roll out in sections, BUT, I would like to be able to explain this to instructors.

[vkg]

We have some classes where the same quiz is used for all sections -- since there are more than 1,000 students in all sections we hit this every time.  While we can download the raw data, we then have to compute the totals.  We really need the ease of viewing summary results online -- it's even more important in our largest classes!

[cholling · Accepted solution]

Heidi, this appears to be a display resource allocation issue. For very large result sets it's hard to get it all analyzed and displayed on the screen. Either you copied and pasted in portions, or Canvas has updated the document since you posted nearly a year ago because it now is clearer that while the results don't show on the screen you can still get your stats by downloading the Student Analysis Report then viewing the CSV vile.

[kona]

 @heidi1 , I also find these limitations frustrating and did a quick search and found the following feature ideas:

• - made it to the "Under Consideration" stage and was responded to by Instructure with the following, "Quiz statistics in the Modern Quizzing Engine will be far more scalable. This is a known issue we intend to address."
• - was archived due to lack of interest (which seems crazy), but could be revived.

My recommendation is to add your support for both of these ideas to the Canvas Studio: Modern Quizzing Engine​ and also consider reviving the feature idea for increasing the number of submissions that are supported.