New Quizzes Item Analysis Report Comparison

[#1]

This document compares the old Item Analysis report and the new Item Analysis report available in New Quizzes. Updated user guides will be available on September 16th, 2023.

	Old Report	New Report
Report Generation	Generated every 24 hours	On-demand generation
Quiz attempts (when multiple attempts are enabled)	All attempts are included	Last attempt included for each student
Quiz Analysis - Median Score	Not available	Included
Quiz Analysis - Standard Deviation	Standard deviation represents a points-based value.	The standard deviation represents a percentage-based value to align with the mean score. This allows for a better understanding of the dispersion or spread of scores relative to the average performance.
Quiz Analysis - Cronbach’s Alpha	Random items (items added from Item Banks at random)  are included in the Cronbach’s Alpha calculation.	Random items are excluded from Cronbach’s Alpha calculation to ensure proper measurement of internal consistency
Item Analysis - Median Earned Points	Not available	Included
Item Analysis - Discrimination Index	All students are included to calculate the discrimination index.	Students who haven’t received an item are excluded when calculating the discrimination index.
Item Analysis - Pearson Correlation Coefficient (rpb)	The point-biserial (rpb) correlation coefficient is used.	Corrected item-total correlation coefficient is used.
Performance by Quintile	Focused on individual question answers rather than reflecting students' overall quiz performance.	Not available yet.