Help me understand Outcomes calculations when affiliated with quiz questions

[kbink]

Hi There,

I'm trying to help a department set up outcomes for and end of year evaluation of their curriculum.  They have specific outcomes from an outside organization.  They will use New Quizzzes and affiliate an outcome with each multiple choice question, probably worth one point.  There will be multiple questions for each outcome.

In the another use we set up the outcomes with 4 Proficiency ratings and 4 was mastery and we set a proficiency calculation that they must achive mastery at least 4 times.

How do I do that in this case?  A one point question is 1 correct or 0 incorrect?  Do I have to use a 1 mastery 0 no mastery proficiency rating in the outcome? And then I could set the calculation to achieve 3 times if I wanted to show that they got 3/4 correct on the exam.  I wouldn't be able to use the outcomes in any other place, and I'd have to ensure that outcome had at least 4 questions (or for example if there were only 3, 1 wrong would = no mastery).

Are there other ways to do this? say if I wanted 75% correct on the questions in an outcome to be equivalent to mastery.  In the end, these results are only used for the department.  They will not impact students, or ideally even be released to students.  The department want's to determine how their curriculum is doing for each outcome.  They might also need to identify questions that are poor, but I think they can do that at the Quiz level with the reports they have there.

Really, I just couldn't find any documentation that would explain how scores on quizzes relate back to mastery scores on outcomes, if there are several Proficiency ratings in the outcome.  I'm making a guess at the setup with pass/no pass ratings.

Thanks for any help you can provide.

[James · Accepted solution]

@kbink 

I try not to use New Quizzes and I haven't used outcomes in a long time, but I've got 10 minutes between classes, so let me throw out what would make sense to me based off what I have seen. Again, I have not tested this, although someone showed me outcomes from New Quizzes two days ago (I didn't have my glasses on, though).

Each quiz question that is linked to an outcome should generate a score. If you have three questions tied to the same outcome, you would get three scored items. Those three scores would be used in the calculation of the score depending on how you specify it (most recent, highest, decaying average, number of times, etc). If you have four quizzes and each one is associated with the same outcome three times, then you have 12 scores used to compute the mastery.

I do not know what would happen if you have varying scores (quiz 1 is 2pts each question, but quiz 2 has 5 pts per question).

I'm willing to be way off base here, but maybe it will encourage someone who uses these to speak up.

If no one knows, you could always go into your test or beta instance and see what happens.