Quiz statistics for quiz with grouped questions

[christine_ruddy]

We have a final assessment quiz of 15 questions that pulls questions from various groups. Canvas will not download statistics for all of the questions but only a version of the quiz.

I have read it is not possible to get the statistics for all the questions when they are grouped, but this seems to be a serious limitation and wondering if anyone out there has any ideas for a work around to this problem.

Thanks 

[james_whalley]

@christine_ruddy Is this for a specific quiz that has already run or are you looking to have an answer for this moving into the future?

[christine_ruddy]

HI @james_whalley this quiz has already been run and has been completed by many students. It's in the classic quiz style. We will be running the same quiz again for the upcoming semester.

Thank you

[james_whalley]

@christine_ruddy I just did some testing with two student users taking a quiz with one question group that contains two questions. Each student ended up getting a different question. In the Quiz Summary under Question Breakdown, it shows me statistics for each question. Both also appear in the Item Analysis and the Student Analysis shows the questions and answers for each student as well.

Is it one of these reports that is not giving you the full information you require or is it another report? Would it be possible for you to share an anonymized version of what you are getting and explain what you expect to see and are not seeing?

[christine_ruddy]

Hi James, the first problem is being informed that statistics for the quiz cannot be rendered ...

Then, when I download the item analysis, I only got stats for 22 questions, when there are far more in the quiz (in groups).

I've had a colleague try and he's gotten the stats for the same 22 questions as myself (and I've gotten the same after downloading several times).

We have a lot of students enrolled in this course - 5000 + (it's a compulsory module), so that is probably a problem. 

Only think is we'd really like to get stats for all the questions so we can properly interrogate the data and update the content and quiz questions accordingly.

Thank you 

[james_whalley]

@christine_ruddy Ugh...we had a similar thing with New Quizzes Quiz Logs the other day that weren't created for a number of users in a course. The ticket ended up in the hands of Instructure engineers and we are hoping for some good news. I think the best thing you can do is get a ticket in to support@instructure.com to see if they can help salvage the data. I don't. think there is anything you or any account admin at your institution will be able to do.

Best,

James

[christine_ruddy]

Hi James,

Yes, I will email them. the data is really important for us to understand students' understanding of the topic so it's frustrating to only be able to access part of it.

Thanks so much for your help anyway. I really appreciate it!

Christine

[bdobbs]

Has anyone seen any resolution to this? 

I would like to do the same. I want to identify which questions are most troublesome for students and build support around those.

I would also like to do this with the formula questions. I give unlimited attempts and I would like to know which ones are most challenging.