Register for InstructureCon25 • Passes include access to all sessions, the expo hall, entertainment and networking events, meals, and extraterrestrial encounters.
In this Canvas release (20 January), additional question types are included in the Answer Frequency Summary in the Item Analysis Report.
Screencast | View the New Feature Screencasts page for a compilation of all available videos in this release. All Resources | Features in this release may be included in product blogs and other content areas. For all related links, view the 2024-01-20 Community tag
|
Feature Options |
Feature options allow institutions to enable newly developed Canvas functionality according to their preferred time frame. Unless otherwise noted, all feature options are opt-in and do not require any action by a Canvas admin until a feature’s enforcement date is announced. For a complete list of feature options, please see Canvas LMS Feature Options.
A feature preview label indicates a feature option in active development, which is being built directly through user feedback. Feature previews deploy updates outside the regular Canvas release schedule and are posted in the Related Releases section in Canvas Releases & Deploys.
Please reference the table below each feature heading for specific feature information. For general information about feature options, please see the Canvas Release Notes FAQ.
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2023-12-18 |
Production Environment Availability |
2024-01-20 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
Yes |
Affected User Roles and Areas |
Instructors, New Quizzes |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
|
Feature Video |
Release Screencast: Not Available |
Summary
In the Item Analysis Report, the Answer Frequency Summary charts display the total number of correct responses, incorrect responses, and no responses for the following question types:
Change Benefit
This update provides additional question types for instructors to evaluate student responses and patterns in order to provide appropriate intervention.
Feature Workflow
Answer Frequency Summary chart for Categorization questions.
Answer Frequency Summary chart is available for Categorization questions.
Answer Frequency Summary for Matching questions.
Answer Frequency Summary chart is available for Matching questions.
Answer Frequency Summary chart for Ordering questions.
Answer Frequency Summary chart is available for Ordering questions.
Answer Frequency Summary chart for HotSpot questions.
Answer Frequency Summary chart is available for Hot Spot questions.
Answer Frequency Summary chart for Formula questions.
Answer Frequency Summary chart is available for Formula questions.
Date | |
---|---|
2023-12-18 | Published Release Notes |
In this Canvas release (17 February), observers can sign up for appointment groups when enabled by an institution and the instructor. Classic Quizzes' practice quizzes are migrated to New Quizzes with zero-point quiz settings enabled. The CSV format of the Quiz and Item Analysis report can be downloaded and in the Item Analysis Report, the Answer Frequency Summary tables display for additional question types.
Screencast | View the New Feature Screencasts page for a compilation of all available videos in this release.
All Resources | Features in this release may be included in product blogs and other content areas. For all related links, view the 2024-02-17 Community tag.
Table of Contents
Summary Link |
|
Affects User Interface |
Yes |
Affected Feature Areas |
Calendar |
Account Setting to Enable |
Allow observers to sign-up for appointments when enabled by the teacher |
Related Ideas |
[Calendar] Parents booking appointments (Observers using the calendar scheduler) |
Summary
When the Allow observers to sign up for appointments setting is enabled in the Root Account Settings and permitted by an instructor during the appointment group creation, observers have the option to join appointment groups.
Change Benefit
This feature enables observers to engage in appointments, providing them with improved access to their students' education.
Feature Workflow
In the Root Account, select the Allow observers to sign up for appointments when enabled by the teacher checkbox and then update settings.
Note: Sub-accounts inherit this setting, but it is not lockable. Sub-account administrators have the capability to modify this setting.
When creating an appointment group, select the Allow observers to sign-up checkbox.
Note: If the appointment group is associated with numerous courses across various sub-accounts, all sub-accounts must allow observers to reserve appointment groups or the checkbox will not be available.
In the Calendar, observers can click the Find Appointment button to view all available appointment groups.
Select the desired appointment time.
Click the Reserve link.
To change your appointment, click the Un-reserve link.
Additional Details
If an account later disables the setting, existing appointment groups that support observer reservation are unaffected however, teachers cannot create new appointment groups for Observers. Additionally, if an appointment group that supports observer sign-up is amended to include a course in a sub-account that does not allow observer sign-up, observers will lose the ability to make reservations for that group. However, existing reservations will remain unaffected.
Feature Video
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="ObserverAppointmentGroups" src="https://community.instructuremedia.com/embed/24f4d460-ff91-40d4-a819-8c1d2cb18e56" frameborder="0"></iframe>
Feature options allow institutions to enable newly developed Canvas functionality according to their preferred time frame. Unless otherwise noted, all feature options are opt-in and do not require any action by a Canvas admin until a feature's enforcement date is announced. For a complete list of feature options, please see Canvas LMS Feature Options.
A feature preview label indicates a feature option in active development, which is being built directly through user feedback. Feature previews deploy updates outside the regular Canvas release schedule and are posted in the Related Releases section in Canvas Releases & Deploys.
Please reference the table below each feature heading for specific feature information. For general information about feature options, please see the Canvas Release Notes FAQ.
Feature Option Name to Enable |
New Quizzes Optional: New Quizzes Migration Enabled by Default New Quizzes Migration Required |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-01-15 |
Production Environment Availability |
2024-02-17 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
No |
Affected Areas |
New Quizzes |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
None |
Summary
Classic Quizzes' practice quizzes are migrated to New Quizzes with zero-point quiz settings enabled by default.
Change Benefit
This functionality enables instructors to swiftly and effortlessly transfer practice quizzes, eliminating the need for manual updates to each individual quiz.
Feature Workflow
When a classic practice quiz is migrated, the New Quiz zero-point settings are enabled by default.
Note: Instructors can change these settings as needed.
Feature Video
Not Available |
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-01-15 |
Production Environment Availability |
2024-02-17 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
Summary
In New Quizzes, the CSV format of the Quiz and Item Analysis report can be downloaded, encompassing all metrics and Answer Frequency Summary tables accessible through the User Interface.
Change Benefit
This functionality allows admins and instructors to easily download data via CSV for a comprehensive look at quiz effectiveness. This provides the data as needed to create custom reports and support learning outcomes.
Feature Workflow
To export the Quiz and Item Analysis report, click the Export CSV button.
Additionally, the Export CSV button displays when viewing the Quiz and Item Analysis report.
Feature Video
Embed Code
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-02-17 New Quizzes Quiz and Item Analysis CSV download" src="https://community.instructuremedia.com/embed/39037de8-686f-4194-a1a9-3aff8db3adcc" frameborder="0"></iframe>
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-01-15 |
Production Environment Availability |
2024-02-17 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
Summary
In the Item Analysis Report, the Answer Frequency Summary tables display the total number of correct responses, incorrect responses, and no responses for the following question types:
Change Benefit
This update provides additional information on specific question types for instructors to evaluate student responses and provide appropriate intervention.
Feature Workflow
Answer Frequency Summary chart for Multiple Choice question types.
Answer Frequency Summary chart is available for Multiple Choice question types.
Answer Frequency Summary chart for Multiple Answer question types.
Answer Frequency Summary chart is available for Multiple Answer question types.
Answer Frequency Summary chart for True or False question types.
Answer Frequency Summary chart is available for True or False question types.
Feature Video
Not Available |
In this Canvas release (16 March), admins can search and sort Account Developer Keys. Within the Gradebook, instructors have the option to select multiple filter choices for each filter type. SpeedGrader's media recorder includes screen capture and automatic captioning. Additionally, an update is made to the Quiz and Item Analysis Report for Fill in the Blank question types.
All Resources | Features in this release may be included in product blogs and other content areas. For all related links, view the 2024-03-16 Community tag.
Table of Contents
Beta Environment Availability |
2024-02-19 |
Production Environment Availability |
2024-03-16 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Developer Keys-Manage |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Developer Keys |
Related Ideas |
Summary
On the Developer Keys page, admins can search and sort Account Developer Keys and Inherited Developer Keys in an account.
Change Benefit
This feature enhances the ease and efficiency of managing the Developer Keys page.
Feature Workflow
Admins can filter by key type [1], search by specific details [2], and clear the search results [3].
Note: For institutions that have more than 10 developer keys, click the Show All Keys button before searching to search all developer keys.
Additionally, each column can be sorted in ascending or descending order using the arrow icon.
Feature Video
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-03-16 Developer Keys Search and Sorting" src="https://community.instructuremedia.com/embed/df15c51a-af8c-4c95-9dae-474ac10d6645" frameborder="0"></iframe>
Beta Environment Availability |
2024-02-21 |
Production Environment Availability |
2024-03-16 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Inherent to User |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Gradebook |
Related Ideas |
Summary
In the Gradebook, instructors can choose multiple filter options for each filter type.
Change Benefit
This update improves the user experience by streamlining the process of managing filter selections, offering increased customization options, and facilitating faster filter navigation.
Feature Workflow
Instructors can select multiple filter options when viewing the Gradebook.
Additional Details
Additionally, Instructors can manage selections directly from the pill in the Gradebook.
Feature Video
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-03-16 Gradebook Multi Select Filters" src="https://community.instructuremedia.com/embed/7a0fecdb-972d-4b95-94e1-e54539e94ab5" frameborder="0"></iframe>
Beta Environment Availability |
2024-02-21 |
Production Environment Availability |
2024-03-16 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Name of Permission relevant to feature area |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
SpeedGrader Media Comments |
Related Ideas |
Summary
In SpeedGrader, the media recorder includes screen capture and captioning.
Change Benefit
This update enhances the clarity of instructor feedback and improves accessibility by providing a streamlined user experience.
Feature Workflow
Image Coming Soon
When creating a media comment, click the Screen Capture icon to begin recording the display screen. Additionally, captioning is auto-enabled for voice overs.
Additional Details
The screen capture and captioning are available for media comments in SpeedGrader only. Additionally, the recorder is only available in Chrome and Edge. Currently, there are no plans to introduce support for Firefox and Safari in the recorder.
Feature Video
Screencast coming soon Subscribe to this article to be notified of updates |
Feature options allow institutions to enable newly developed Canvas functionality according to their preferred time frame. Unless otherwise noted, all feature options are opt-in and do not require any action by a Canvas admin until a feature's enforcement date is announced. For a complete list of feature options, please see Canvas LMS Feature Options.
A feature preview label indicates a feature option in active development, which is being built directly through user feedback. Feature previews deploy updates outside the regular Canvas release schedule and are posted in the Related Releases section in Canvas Releases & Deploys.
Please reference the table below each feature heading for specific feature information. For general information about feature options, please see the Canvas Release Notes FAQ.
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-02-19 |
Production Environment Availability |
2024-03-16 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes Item Analysis Report |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
Summary
The following data is added to the Quiz and Item Analysis report:
Change Benefit
This update provides additional information on specific question types for instructors to evaluate student responses and provide appropriate intervention.
Feature Workflow
In the Quiz and Item Analysis Report, the Answer Frequency Summary [1] and Aggregation [2] display.
Feature Video
Not Available |
For more information, please see Upcoming Canvas Changes.
In this Canvas release (20 April), External tools using the submission_type_selection placement have an updated interface in the Assignment Submission Type field. On the Developer Keys page, an LTI Registration option is added for admins. At the Account and course-level, the Grading Schemes page interface is redesigned and allows archiving schemes. A default icon with the first initial of the tool’s name displays for tools without icons in the Editor Button.In consortiums standard, developer key states and tokens are not inherited to child accounts, and toggling Developer Keys in the parent account doesn't affect tool installations in child accounts. The Mobile offline mode feature option is available for admin. New Item Analysis report data is available for Essay, File Upload and Numeric question types. The Moderation page in New Quizzes presents the question position of answered questions in its View Log.
All Resources | Features in this release may be included in product blogs and other content areas. For all related links, view the 2024-04-20 Community tag.
Table of Contents
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
All LTI Tools |
Permissions |
Manage Assignments and Quizzes- add/edit |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Assignments |
Related Ideas |
None |
Summary
In Assignments, external tools using the submission_type_selection placement have an updated interface in the Assignment Submission Type field. This update displays the configured icon, name of the tool and a description.
Note: An institution must set up the submission_type_selection placement for an external tool on the Developer Keys page in order to display in Assignments.
Change Benefit
The update improves cohesion and enhances the overall visual aesthetics of the Canvas user interface.
Feature Workflow
In Assignments, an external tool using the submission_type_ selection placement displays an icon [1], the name of the tool [2] and the tool description [3].
Feature Video
Not Available Subscribe to this article to be notified of updates |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
All LTI Tools |
Permissions |
Developer Keys-Manage |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Developer Keys |
Related Ideas |
None |
Related Blog |
Installing LTI 1.3 Tools is Easier than Ever with Dynamic Registration |
Summary
On the Developer Keys page, an LTI Registration option is added for admins to automatically share information between Canvas and various tools to set up a Developer Key.
Change Benefit
This feature allows admins to more quickly and efficiently add LTI tools.
Feature Workflow
On the Developer Keys page, click the Add Developer Key button [1], and then click the Add LTI Registration link [2].
Enter the Dynamic Registration URL [1], and then click the Continue button [2].
Login to the desired tool and install the external tool.
Note: This workflow varies between external tools.
In Settings, admin can manage permissions and placements of the external tool. By default, all permissions and placements are enabled. Then, click the Enable and Close button.
Once enabled, the external tool displays on the Developer Keys page. To edit the tools settings, click the Edit icon.
Admins can click the Restore Defaults button to revert all settings back to their default configurations.
Feature Video
Embed Code:
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-04-20 Developer Keys Dynamic Registration" src="https://community.instructuremedia.com/embed/53c3b373-4b3e-436b-8f06-ca7864bac96f" frameborder="0"></iframe>
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Grades-Edit |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Course and Account level Grading Schemes |
Related Ideas |
Summary
At the account and course-level, the Grading Schemes page interface is redesigned. Additionally, admins and instructors can archive grading schemes as well as edit the name and description of grading schemes currently in use.
Change Benefit
This functionality increases flexibility when managing grading schemes.
Feature Workflow
In Account Grading Settings, to archive a grading scheme, click the Archive icon.
Once a grading scheme is archived, it is moved to the Archived section [1]. To restore the grading scheme, click the Unarchive icon [2].
Note: Archived grading schemes in use can still be used, but cannot be added to new courses or assignments unless they are restored.
In Course Settings, a View button [1], Copy button [2], and Add New Grading Scheme buttons [3] are added.
In Course Settings, the Manage All Grading Schemes modal is redesigned. Additionally, instructors can edit titles and descriptions of grading schemes already in use with the Edit icon [1]. Instructors can archive grading schemes using the Archive Icon [2] and restore archived grading schemes with the Unarchive icon [3].
Notes:
Additional Details
Editing the name and description of grading schemes currently in use does not allow edits to percentages or points in the grading scheme. Additionally, a grading scheme established at the course level cannot be deleted, archived, or edited at the account level. Similarly, a grading scheme created at the account level cannot be deleted, archived, or edited at the course level.
Feature Video
Embed Code:
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-04-20 Grading Archive Grading Schemes" src="https://community.instructuremedia.com/embed/a1b4dcc9-9021-439c-bbb9-015f6a2307b7" frameborder="0"></iframe>
Affected Feature Areas |
Rich Content Editor |
Account Setting to Enable |
None |
Affects User Interface |
Yes |
Related Ideas |
None |
Summary
LTI keys created at the account level without icons in the Editor Button placement automatically display a default icon with the first initial of the tool’s name in the Rich Content Editor.
Change Benefit
This update provides consistency and ensures all LTI tools display in the External tool menu.
Feature Workflow
Rich Content Editor External Tool Default Icon
When no icon is set for an LTI tool the default icon displays in the menu and in the All Apps view.
Feature Video
Not Available Subscribe to this article to be notified of updates |
Feature options allow institutions to enable newly developed Canvas functionality according to their preferred time frame. Unless otherwise noted, all feature options are opt-in and do not require any action by a Canvas admin until a feature's enforcement date is announced. For a complete list of feature options, please see Canvas LMS Feature Options.
A feature preview label indicates a feature option in active development, which is being built directly through user feedback. Feature previews deploy updates outside the regular Canvas release schedule and are posted in the Related Releases section in Canvas Releases & Deploys.
Please reference the table below each feature heading for specific feature information. For general information about feature options, please see the Canvas Release Notes FAQ.
Feature Option Name to Enable |
Mobile Offline Support |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Subaccount Configuration |
No |
Permissions |
Account-level settings - manage |
Affects User Interface |
Yes |
Affected Areas |
Mobile Apps |
Mobile App Support |
Feature Option enablement is available in the web version only |
Free-for-Teacher Availability |
Not Available |
Feature Option State |
Production-ready |
Related Ideas |
Summary
The Mobile offline mode feature option is available to admin allowing students to sync course content to view as read-only when offline.
Notes: Canvas for Elementary courses and the use of external tools that require the internet are not available in Mobile Offline Mode. Studio media remains available. As instructors develop course content, it is essential to carefully consider the origin of visual elements or links associated with the material.
Change Benefit
This feature provides users increased flexibility, productivity, and improved experiences in various scenarios where internet connectivity may be unreliable or unavailable.
Feature Workflow
To enable Mobile offline mode, click the Enable link.
Additional Details
For more information about the student mobile view, see the Canvas Student Release Notes (iOS 7.0) and the Canvas Student Release Notes (Android 7.0).
Feature Video
Not Available |
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Subaccount Configuration |
Yes |
Permissions |
Inherent to user role |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes Item Analysis Report |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
Summary
The following data is added to the Item Analysis report:
Change Benefit
This update provides additional information on specific question types for instructors to evaluate student responses and provide appropriate intervention.
Feature Video
Not Available Subscribe to this article to be notified of updates |
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Subaccount Configuration |
Yes |
Permissions |
Manage Assignments and Quizzes- add/edit/delete Grades-edit |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes Moderate Page |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
None |
Summary
On the New Quizzes Moderate page, a configure icon is added allowing instructors to switch between percentages and raw points in the score display column.
Change Benefit
This feature improves reporting flexibility and grading system alignment.
Feature Workflow
To switch between percentages and raw points in the score column, click the Configure icon.
Feature Video
Not Available Subscribe to this article to be notified of updates |
Feature Option Name to Enable |
New Quizzes |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Subaccount Configuration |
Yes |
Permissions |
Manage Assignments and Quizzes- add/edit/delete Grades-edit |
Affects User Interface |
Yes |
Affected Areas |
New Quizzes Moderation Log |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
[New Quizzes] View Log in New Quizzes needs useful information |
Summary
In New Quizzes the Moderation page View Log includes the question position of the answered question.
Change Benefit
This update allows instructors to easily verify the question position as students complete quizzes.
Feature Workflow
In the View Log of a New Quiz, the question position or question number displays.
Feature Video
Not Available Subscribe to this article to be notified of updates |
Beta Environment Availability |
2024-03-18 |
Production Environment Availability |
2024-04-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Inherent to user |
Related APIs |
None |
Affects User Interface |
No |
Affected Area |
Developer Keys |
Summary
Developer Key state and tokens from the consortium parent are not inherited to child accounts. Additionally, turning On/Off Developer Keys in the parent account of a non-centrally managed Consortium does not affect the tool installs of the child accounts.
Change Benefit
This update allows the tool to launch properly when enabled for the context.
Feature Video
Not Available Subscribe to this article to be notified of updates |
In September, we introduced the new Quiz and Item Analysis report, focusing on improving its speed. I am delighted to announce that the 24-hour report generation time has now been reduced to an average of under a minute.
While the report has seen significant improvement, we acknowledge that some key features are still missing, such as Answer Frequency Summary tables for all question types and a downloadable format for further analysis.
Since the initial release, we have continued to make improvements, including:
Today, on January 15th, 2024, we are launching CSV download support for the Quiz and Item Analysis in beta, with the production release scheduled for one month later.
In response to positive feedback received on adding JSON to the CSV report in my last blog post, we decided to add the Answer Frequency Summary table data to the CSV in JSON format and soon will be updating our guides to include instructions on downloading the CSV file and understanding the JSON format.
Our commitment to improving the Quiz and Item Analysis continues. The team is currently focused on adding the Answer Frequency Summary table to Fill In The Blank question type, set for release later this quarter.
The old quiz and item analysis report generation will be discontinued on January 22nd. From that date, only the new process will be available for generating reports. However, previously generated reports for older quizzes will remain accessible until the summer of 2024, giving users ample time to transition and familiarize themselves with the new process and calculations.
For those unfamiliar with the changes, you can compare the old and new reports here or gain a better understanding of each metric and calculation method here.
In this Canvas release (20 July), instructors can assign ungraded discussions to students and sections. The Account Navigation now includes a link to the Analytics Hub. In Account Settings, admins can enable Inbox Signature blogs and Auto responses. Intelligent Insights is Instructure’s new product offering in analytics and AI. On the Modules page, instructors can assign students to entire modules or individual module items directly from the page. Instructors can also assign pages to students and set availability dates. The Assign To button is available in Assignments and Discussions, and the Assign To user interface in Assignments, Discussions, and Quizzes has been redesigned in a tray format. Canvas’ Admin Analytics and Course Analytics features are migrated to the Data Access Platform (DAP). The Discussion Create and Edit page uses Apollo/GraphQL to fetch and update data. At the Account level, the legacy Analytics link is removed. The New Course and User Analytics feature is enforced for all Canvas institutions, and the feature option is removed from the user interface. An entry point for Admin Analytics is added to the Analytics Hub, and the Admin Analytics page includes an Intelligent Insights option in the navigation menu for users of this feature. A Top Navigation LTI Placement feature option is available for admin to enable. The Rubrics page, at both the admin and course levels, is redesigned allowing admins and instructors to search and sort rubrics, view where rubrics are used, duplicate and archive rubrics, and more easily edit existing rubrics.
All Resources | Features in this release may be included in product blogs and other content areas. For all related links, view the 2024-07-20 Community tag.
Table of Contents
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Discussions-create Discussions-moderate Additionally, either a course admin enrollment or an enrollment that's not section restricted |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Discussions |
Related Ideas |
None |
Summary
In Discussions, instructors can assign ungraded discussions to students and sections. Additionally, section restricted enrollments allowing students to post discussions to a specific section is removed. Instructors can still create groups, and students within those groups can initiate discussions that are visible only to their group members.
Change Benefit
This update streamlines instructor workflow and improves the ability to differentiate instruction.
Feature Workflow
To assign students or sections to an ungraded discussion, click the Manage Assign To link on the create or edit a discussion page.
Instructors can select which students are assigned the ungraded discussion.
Note: Only students assigned to the discussion can view and participate in the ungraded discussion.
Feature Video
See Feature Video for Modules and Assignment Differentiation |
Beta Environment Availability |
Not available in the beta environment |
Production Environment Availability |
2024-07-09 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Analytics Hub |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Navigation |
Related Ideas |
None |
Related Blog |
Introducing Analytics Hub: Your central gateway to all things Data, Analytics and Insights |
Summary
In Account Navigation, an Analytics Hub link is available. The Analytics Hub displays all data and analytics for the following features:
Note: Specific data and analytics solutions are based on feature option settings and individual users permissions.
Change Benefit
This feature improves an admin’s workflow by consolidating all data and analytics capabilities in one page.
Feature Workflow
In Account navigation, an Analytics Hub link is available.
Users without access to Intelligent Insights can access other product data and analytics in the Analytics Hub.
Using the Analytics Hub, admins can view data for the following areas depending on feature option settings and individual users permissions:
Feature Video
Not Available |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
Account Settings |
Account Setting to Enable |
Enable Inbox Signature Block |
Subaccount Configuration |
No |
Name of LTI Tool |
None |
Permissions |
Inherent to user |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Inbox |
Related Ideas |
Summary
When the Enable Inbox Signature Block is enabled, users have the option to configure a signature when composing a message. Additionally, admins have the option to disable the Inbox Signature Block for students.
Note: The Enable Inbox Signature Block setting is disabled by default.
Change Benefit
This feature streamlines communication and enhances the effectiveness and professional appeal of inbox messages.
Feature Workflow
In Account settings, select the Enable Inbox Signature Block checkbox to enable for all users. To disable this feature for students select the Disable Inbox Signature Block for Students checkbox.
Note: By default, the Disable Inbox Signature Block for students checkbox is not selected.
In the Inbox, click the Settings button.
To create a signature, select the Signature On radio button [1] and enter the desired signature in the Signature field [2]. Then, click the Save button [3].
Once a signature is saved, it displays in the message body when composing a message.
Feature Video
See the Feature Video for Add Auto Response to Messages. Subscribe to this article to be notified of updates |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
Account Settings |
Account Setting to Enable |
Enable Inbox Auto Response |
Subaccount Configuration |
No |
Name of LTI Tool |
None |
Permissions |
Inherent to user |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Inbox |
Related Ideas |
Summary
When Enable Inbox Auto Response is enabled, users have the option to set an auto-response for messages. Additionally, admins have the option to disable the Inbox Auto Response for students.
Note: The Enable Inbox Auto Response setting is disabled by default.
Change Benefit
This feature streamlines communication and enhances the effectiveness and professional appeal of inbox messages.
Feature Workflow
In Account Settings, select the Enable Inbox Auto Response checkbox to enable the feature for all users. To disable this feature for students select the Disable Inbox Auto Response for Students checkbox.
Note: By default, the Disable Inbox Signature Block for students checkbox is not selected.
To create an auto-response message, select the Response On radio button [1] and enter the Start Date [2], End date [3], Subject [4] and Message [5]. Then, click the Save button [6].
Feature Video
Embed Code:
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Inbox Add Signature to Messages and Add Auto Response to Messages" src="https://community.instructuremedia.com/embed/1dff4ce4-2e02-4b9a-9d32-85806a7bcef5" frameborder="0"></iframe>
Beta Environment Availability |
Not available in the beta environment |
Production Environment Availability |
2024-07-09 |
Location to Enable Feature |
None |
Name of LTI Tool |
Contact Customer Success Manager |
Permissions |
Name of Permission relevant to feature area Intelligent Insights Account Role - Students in Need of Attention - Course Readiness - Ask Your Data - LTI Usage |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Intelligent Insights |
Related Ideas |
None |
Summary
Intelligent Insights is Instructure’s new product offering in the area of analytics & AI.
The four features of Intelligent Insights are:
Note: Intelligent Insights is a paid product offering, please contact your Customer Success Manager for more information.
Change Benefit
This product enables self-service analytics and proactively surfaces actionable insights that inform strategic initiatives to improve course and edtech effectiveness, student retention, and graduation rates.
Feature Workflow
Admins can access Intelligent Insights through the Analytics Hub or Admin Analytics.
In Course Readiness, admins can create specific criteria to define course readiness for their institution.
Then, the admin can view data based on the institution's criteria for course readiness.
In the Students in Need of Attention page, admins can customize criteria [1], message students in need [2], filter results [3], and view bulk data [4].
Additionally, admins can view more detailed information about individual students.
Admins can interact with and query their data instantly, quickly visualizing results.
With the LTI Usage dashboard, admins can gather insights on the following questions:
Additional Details
Please note that the LTI Usage dashboard is a part of Intelligent Insights and Impact. As such, LTI Usage Release Notes can be found with the Impact Release Notes in the Instructure Community when available.
Feature Video
Not Available |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
To change the Assign To settings for Modules and Module Items:
To open the Assign To tray from a module item’s create page:
|
Related APIs |
|
Affects User Interface |
Yes |
Affected Areas |
Modules |
Related Ideas |
[Modules] Module access to specific groups, sections or students [Modules] Hiding and Viewing Modules for Individual Sections |
Related Blogs |
Summary
On the Modules page, instructors can assign students to an entire module and individual module items from the Modules page. Additionally, the Add Module and Edit Module Settings pages are redesigned as trays.
Notes:
Change Benefit
This feature improves the differentiation of Modules to create a more dynamic and adaptive learning environment.
Feature Workflow
When creating a new module, the Add Module modal is changed to a tray.
When editing a module, the Edit Module Settings is redesigned to display as a tray with a Settings tab and an Assign To tab.
Note: The existing module settings remain unchanged.
Using the Assign To tab, instructors can set the module visibility to Everyone [1] or assign it to specific students [2]. In the Assign To field [3], instructors can select students or sections using the drop-down menu, typing student names, SIS IDs (if available), or section names . Lastly, click the Save button [4].
Note: By default, the modules and items are assigned to everyone.
On the Modules page, instructors can also access the Assign To tab by clicking the Options icon [1]. Then, select the Assign To link [2].
When a module is differentiated for specific students, a View Assign To link displays to easily review or edit visibility.
Note: The View Assign To link does not display if the module is assigned to everyone.
To assign a specific module item to a student, click the Options icon [1], then select the Assign To link [2].
After selecting the Assign To link, a tray displays where instructors can differentiate assignment availability dates and due dates. Then, click the Save button.
Additionally, instructors can edit and differentiate visibility dates for students for pages.
Note: Pages and ungraded discussions cannot be assigned due dates.
Additional Details
This feature is not available in the Mobile app. However, the feature can be used on a mobile device when viewing in a web browser. This feature is not yet available when using Course Pacing.
Feature Video
Embed Code
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Modules and Assignment Differentiation" src="https://community.instructuremedia.com/embed/9fd0d8f1-86d2-437f-91ae-f7543c23ecec" frameborder="0"></iframe>
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Pages - update |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Pages |
Related Ideas |
Summary
Instructors can assign pages to students and set availability dates. Additionally, instructors can assign Pages to Mastery Paths.
Note: Pages cannot be assigned due dates.
Change Benefit
This update streamlines instructor workflow and improves the ability to differentiate instruction.
Feature Workflow
Assign To Button
When viewing a page, instructors can use the Assign To button to quickly manage availability dates and assign them to students.
Pages Manage Assign To Link
When editing or creating a page, click the Manage Assign To link.
Pages Assign To TrayInstructors can differentiate pages as well as manage availability dates in the Assign To tray. Then, click the Apply button.
Manage Assign To Pending Changes Pill
After applying changes and closing the tray [1], a pill displays stating that changes are not yet saved [1]. To save changes, click the Save button [2].
Pages Assign To Master Paths
When assigning pages, instructors can also choose to assign the page to Mastery Paths.
Note: The Allow in Mastery Paths checkbox is removed.
Feature Video
See Feature Video for Module and Assignment Differentiation |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
Manage Assignments and Quizzes - add Discussions - create |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Areas |
Assignments, Discussions, Quizzes |
Related Ideas |
Summary
In Assignments and Discussions, an Assign To button is available. In Assignments, Discussions and Quizzes, the Assign To user interface is redesigned in a tray. Additionally, student SIS IDs are displayed alongside student names when available.
Note: This update is not available in classic discussions.
Change Benefit
This update streamlines instructor workflow and improves the ability to differentiate instruction of assignments and discussions.
Feature Workflow
When viewing an assignment or graded discussion, instructors can use the Assign To button to quickly manage due dates and availability dates.
When editing an assignment, discussion or quiz, click the Manage Assign To link.
Instructors can differentiate assignments, graded discussions and quizzes as well as manage due dates and availability dates in the redesigned tray. Then, click the Apply button.
Additionally, student SIS IDs display when available in the Assign To tray.
When editing in the Assign To tray of an assignment, inherited assignments display if available.
After applying changes and closing the tray, a pill displays stating that changes are not yet saved. To save changes, click the Save button [2].
Feature Video
See Feature Video for Module and Assignment Differentiation |
Feature options allow institutions to enable newly developed Canvas functionality according to their preferred time frame. Unless otherwise noted, all feature options are opt-in and do not require any action by a Canvas admin until a feature's enforcement date is announced. For a complete list of feature options, please see Canvas LMS Feature Options.
A feature preview label indicates a feature option in active development, which is being built directly through user feedback. Feature previews deploy updates outside the regular Canvas release schedule and are posted in the Related Releases section in Canvas Releases & Deploys.
Please reference the table below each feature heading for specific feature information. For general information about feature options, please see the Canvas Release Notes FAQ.
Feature Option Name to Enable |
Admin Analytics |
Enable Feature Option Location & Default Status |
Account (Enabled/Unlocked) |
Beta Environment Availability |
Not available in the beta environment |
Production Environment Availability |
2024-07-09 |
Subaccount Configuration |
No |
Permissions |
Admin Analytics- view and export data |
Affects User Interface |
Yes |
Affected Areas |
Admin Analytics, Analytics Hub |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
TBD |
Feature Option State |
Production-ready |
Related Ideas |
None |
Summary
An entry point for Admin Analytics is added to the Analytics Hub. On the Admin Analytics page, an Intelligent Insights option is added to the navigation menu for Intelligent Insight users.
On the Analytics Hub page, the following Admin Analytics data is accessible:
Notes: Intelligent Insights is a separate product from Admin Analytics that requires a subscription. For more information, contact your Customer Success Manager (CSM).
Change Benefit
This update improves navigation to Admin Analytics and Intelligent Insights
Feature Workflow
In the Analytics Hub, to view Usage and Adoption, click the Usage Overview link [1]. To view the StudentSuccess, click the Student Overview link [2], and to view Course Effectiveness, click the Courses Overview link [3].
On the Admin Analytics page, institutions with an Intelligent Insights subscription have access to an Intelligent Insights drop-down menu [1]. In the drop-down menu, admins can access insights for Course Readiness [2] and Students in Need of Attention [3]. Additionally, admins can access an Ask Your Data tool [4] and insights related to LTI Usage [5].
Note: Ask Your Data and LTI Usage are external links, therefore saved filters do not apply.
The four features of Intelligent Insights available from Admin Analytics are:
Feature Video
Not Available |
Feature Option Name to Enable |
Top Navigation LTI Placement |
Enable Feature Option Location & Default Status |
Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-07-09 |
Production Environment Availability |
2024-07-20 |
Subaccount Configuration |
No |
Permissions |
Inherent to user |
Affects User Interface |
Yes |
Affected Areas |
All pages with a Top Navigation |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
None |
Summary
When the Top Navigation LTI Placement feature option is enabled and a tool using this placement is enabled, an LTI Tools Menu button displays on all pages with a top navigation bar in Canvas. This placement can be added to LTI 1.3 tools, and admin can pin up to two tools as favorites to display on the top-navigation bar. All other tools with this placement display in the dropdown in the top navigation bar.
Note: This is a restricted placement. For more information institutions should contact their Customer Success Manager and partners should contact Developer Relations.
Change Benefit
This feature allows AI tools to provide more relevant and accurate responses, enhancing user experience by delivering information and assistance tailored to the specific context.
Feature Workflow
When the Top Navigation LTI Placement feature option is enabled, an LTI Tools button displays on pages with a top navigation Bar in Canvas for all users.
In Account Level settings, admin can pin up to two tools to the Top Navigation using the toggle. By default, tools are unpinned.
When a tool is pinned to the Top Navigation, a button displays for each tool.
Any tools that are not pinned display in the LTI Tools drop-down menu.
Additional Details
Approved tools can add the Top Navigation placement and the https://canvas.instructure.com/lti/page_content/show claim. On the Assignment and Wiki pages, the tool will be sent all information from the page on launch.
Feature Video
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Navigation Top Navigation LTI Button" src="https://community.instructuremedia.com/embed/b669e690-c504-409d-9109-01301b65387f" frameborder="0"></iframe>
Feature Option Name to Enable |
|
Enable Feature Option Location & Default Status |
Beta: Account (Enabled/Unlocked) Production: Account (Disabled/Unlocked) |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Subaccount Configuration |
No |
Permissions |
Rubrics-add/edit/delete |
Affects User Interface |
Yes |
Affected Areas |
Rubrics |
Feature Preview User Group |
|
Release Schedule
|
View updates via the change log in the Enhanced Rubrics: Release Change Log |
Mobile App Support |
Not available |
Free-for-Teacher Availability |
Not available |
Feature Option State |
Production-ready |
Related Ideas |
[Rubrics] Editing Capabilities for Rubrics [Rubrics] Rubric Ratings with consistent text wrapping & customisable margins |
Summary
The Rubrics page at the admin and course level is redesigned, allowing admin and instructors to search and sort rubrics, view the location rubrics are used, duplicate and archive rubrics, as well as more easily edit existing rubrics. Additionally, the rubrics create and edit interface is redesigned.
Change Benefit
This feature enhances educational value and improves student learning as institutions focus on effective rubric-based assessments.
Feature Workflow
Account Level Rubric View
At the Account and Course level, the Rubrics page is redesigned. Tabs are available to display Saved [1] and Archived [2] rubrics. A search bar [3] is available and the Create New Rubric button [4] is updated. Admins and instructors can also sort rubrics in ascending and descending order by Rubric name [5], Total Points [6], Criterion [7], and Location Used [8]. Additionally, an options icon [9] is available for each rubric, allowing users to easily edit, duplicate, archive, or delete rubrics [10].
Note: Rubrics cannot be edited or deleted once they have been added to an assignment. However, this can be duplicated for additional edits and the creation of new rubrics.
Account Level Rubric Search and Create New Rubric Button
To search rubrics, enter the rubric name in the search field [1]. To create a new rubric, click the Create New Rubric button [2].
Redesigned Create New Rubric Page
When creating a new rubric, enter a Rubric name [1] and Rating Order [2]. To add a new criterion, click the Draft New Criterion button [3]. To create criterion from an outcome, click the Create from Outcome button [4].
Create New Criterion Modal
When creating a new criterion, enter the Criterion Name [1] and Criterion Description [2]. To enable a point range, select the Enable Range checkbox [4]. Then, determine the desired Points [4]. Rating name [5], and Rating Description [6]. Then click the Save Criterion button [7].
Adding an Outcome to Criterion Modal
When creating a criterion from an outcome, select the desired outcome and click the Import button.
Create New Rubric Edit, Delete and Duplicate Icons
Once the rubric is complete, users can edit [1], delete [2], or duplicate [3] criterion. Additionally, use the drag and drop icon [4] to re-order criteria. Then, either Save as Draft [5], Save Rubric [6], or Preview Rubric [7].
Rubric Location Used Link
On the Rubrics page, click the Courses and Assignments link to view which course rubrics are used.
Location Used Modal
At the account and course level, users can view the list of courses and assignments where the associated rubric is used. Additionally, all courses and assignments are hyperlinked for easy access.
SpeedGrader Rubric View Drop-Down Menu
In SpeedGrader, instructors can manage the rubric view by clicking the drop-down menu to select a Traditional, horizontal, or vertical view. [1]. To apply points, click the Submit Assessment button [2].
Notes:
SpeedGrader Select Rubric Drop-Down Menu
Additionally in SpeedGrader, instructors can use the dropdown menu to switch between their own rubric and the peer-reviewed rubric.
Student View Rubric Display Drop-Down Menu
For students, the peer review rubric view is also updated. Additionally, students can manage the rubric view by clicking the drop-down menu.
Note: The Assignment Enhancements feature option must be enabled for students to view the updated rubric.
Additional Details
The traditional view will not be available if the rubric contains more than five ratings.
Feature Video
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Rubrics Rubric Redesign Phase 1" src="https://community.instructuremedia.com/embed/aa871feb-79ce-4c60-832e-fd71b0fd6942" frameborder="0"></iframe>
Beta Environment Availability |
2024-07-09 |
Production Environment Availability |
TBD |
Location to Enable Feature |
Contact your Customer Support Manager |
Name of LTI Tool |
None |
Permissions |
Inherent to user |
Related APIs |
None |
Affects User Interface |
No |
Affected Area |
Admin Analytics, Course Analytics |
Related Ideas |
None |
Summary
Canvas’ Admin Analytics and Course Analytics features are migrated to the Data Access Platform (DAP).
Note: To enable Admin Analytics and Course Analytics on DAP early before migration on August 1, 2024, contact your Customer Success Manager (CSM)
Change Benefit
This transition offers increased load schedule frequency (every 4 hours instead of the current daily refresh), ensured consistency in metrics with other data products across Canvas, and improved data quality and availability.
Feature Video
Not Available |
Original Production Release Date |
2021-06-19 |
Affected Canvas Areas |
Announcements, Discussions |
Affects User Interface |
Yes |
Summary
The Discussion/Announcement Redesign feature option is enforced for all Canvas institutions and the feature option is removed.
Change Benefit
This change provides users with the most engaging, user-friendly, and efficient discussion and announcement interface.
Additional Details
For additional information, see the Discussion Redesign and Announcement Redesign guides. Additionally, the Discussion/Announcement Redesign user group will be closed 10/18/2024.
Feature Video
Embed Code:
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Discussion/Announcement Enforcement of Discussion/Announcement Redesign" src="https://community.instructuremedia.com/embed/832c1229-ab1d-4614-8501-1d0728b28420" frameborder="0"></iframe>
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Permissions |
Inherent to user |
Affects User Interface |
No |
Affected Area |
Discussions |
Related Ideas |
None |
Summary
The Discussion Create and Edit page is updated to use Apollo/GraphQL to fetch and update data.
Note: Users may notice some interface updates that do not affect functionality.
Change Benefit
This update improves user interface infrastructure, allowing Canvas development teams to leverage the latest design system.
Feature Video
Embed Code:
<iframe width="560px" height="320px" allowfullscreen="true" allow="autoplay *" title="Release Screencast: 2024-07-20 Discussion Create and Edit Page InstUI Update" src="https://community.instructuremedia.com/embed/bf126f23-82ec-4f52-b8d0-4eae0eefd7b3" frameborder="0"></iframe>
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Location to Enable Feature |
None |
Name of LTI Tool |
None |
Permissions |
None |
Related APIs |
None |
Affects User Interface |
Yes |
Affected Area |
Account Navigation |
Related Ideas |
None |
Summary
At the Account level, the legacy Analytics link is removed. For analytics, admins should refer to Admin Analytics and the Analytics Hub links.
Change Benefit
This change reduces the number of areas that administrators need to check for analytics.
Feature Video
Not Available |
Original Production Release Date |
2019-10-19 |
Beta Environment Availability |
2024-06-17 |
Production Environment Availability |
2024-07-20 |
Affected Canvas Areas |
New Analytics |
Affects User Interface |
Yes |
Summary
The New Course and User Analytics feature option is enforced for all Canvas institutions and the feature option is removed from the user interface.
Change Benefit
This change enhances the accuracy, efficiency, and effectiveness of data analysis efforts, providing a significant advantage in a data-driven environment.
Additional Details
For more information, see the New Analytics guides.
Feature Video
Not Available |
This document provides comprehensive information about the New Quizzes Quiz and Item Analysis report, along with the associated calculations. The report includes two main sections: Quiz Analysis and Item Analysis, which address the following topics:
Many of the statistics described include suggested values to understand what you should look for. However, in terms of item analysis, there are no universal answers or value ranges to determine validity or acceptable results; your institution may use different ranges to evaluate some metrics.
The Quiz and Item Analysis report is a request-based report. The report includes responses received up until the point of report creation. However, the following submissions are not included in the Quiz and Item Analysis report:
Report data may display differently due to the following rules:
This section defines the data points that can be found in the Quiz Summary section of the report.
Displays the highest percentage score awarded among students who took the quiz.
Displays the lowest percentage score awarded among students who took the quiz.
Displays the average percentage score among students who took the quiz.
Displays the middle value of percentage scores among the students who took the quiz when all the scores are arranged in ascending order. Unlike the mean score, which can be influenced by extreme values, the median is not affected by outliers.
Displays the average time taken to complete the quiz.
Displays a distribution of percentage scores achieved among students who took the quiz.
Standard deviation is a measure of the average absolute deviation of scores around the mean. A low standard deviation indicates, on average, the scores tend to be close to the mean of the set. A high value indicates, on average, scores vary widely from the mean of the data set. Standard deviation’s unit of measurement should be the same as the displayed mean. For example if a mean is listed as a percentage value, the standard deviation should also be listed as a percentage value.
Standard Deviation is calculated by finding the square root of the average of the squared differences between each submission and the mean:
Standard Deviation Formula
where 𝑛 is the number of responses, 𝜇 is the mean score, and 𝑥ᵢ is the percentage score of the i-th submission.
Outliers are scores that are significantly distant from the mean. Outliers can heavily influence the mean used to calculate standard deviation. If the standard deviation is high and outliers are present, that may mean the standard deviation does not represent the typical value.
Cronbach’s Alpha is an internal consistency measurement that estimates the reliability of a quiz. Values range from 0 to 1, with higher values indicating greater reliability.
Note: Since Cronbach’s Alpha is measuring internal consistency, randomized items would distort the value, so all randomized items in a quiz are excluded.
Cronbach's Alpha Formula
where 𝑘 is the number of questions, 𝜎ᵢ² is the variance of i-th question scores, and 𝜎ₓ² is the variance of the quiz.
Values range from 0 to 1, with higher values indicating greater internal consistency and reliability, meaning the items are strongly correlated and measure the same underlying construct. A value of zero indicates that there is no correlation between the items at all and that they are totally independent from each other. Knowing the answer to one item doesn’t correlate to knowledge needed to accurately answer another item in the quiz.
While there isn’t a strict threshold, a value of 0.70 or higher is considered acceptable. Lower values may be acceptable if the quiz measures a complex topic.
You can assess the corrected item-total correlation coefficient to identify items that might be less correlated to the underlying construct being measured. Removing such items could improve Cronbach’s Alpha.
Cronbach’s Alpha assesses internal consistency, but does not guarantee validity, nor does it address quality.
Displays the average point score achieved among students who were given the item.
Displays the middle value of point scores achieved among students who were given the item when all scores are arranged in ascending order. Unlike the mean score, which can be influenced by extreme values, the median is not affected by outliers.
Item difficulty (also known as p-value) is the proportion of participants who answered the item correctly. Values range from 0 (nobody answered correctly) to 1 (everyone answered correctly).
Note: Calculating the item difficulty operates as a dichotomous question and ignores partial credit or points.
Item Difficulty is calculated by dividing the number of participants who answered the item correctly by the total number of participants. In the case of randomized items, the total number of participants include only the students who received the item as part of their quiz.
Item Difficulty Formula
where 𝐶 is the number of students who answered correctly and 𝑇 is the total number of students.
An item difficulty value close to 1 means that most students answered the item correctly, which might indicate that the item is considered easy for students or might not effectively challenge the students. This might be the intended expectation if an item is used to test mastery. A value closer to 0 suggests that few participants answered the item correctly, which might indicate that the item is challenging for students.
While there is no strict threshold, generally items with item difficulty values below 0.30 are considered too challenging and values above 0.85 considered too easy. If the item difficulty is too high or too low, consider adjusting the item or reviewing the wording to better match the intended difficulty level.
Like any proportion or percentage, the sample size used can greatly influence the item difficulty metric. When the sample size is small, a few submissions can greatly change the value whereas when the sample size is large, it takes more submissions with the same score/value to change the overall item difficulty.
Note: To get a more cohesive picture of an item, consider assessing the discrimination index and the corrected item-total correlation coefficient.
The following calculations help to better understand how individual items relate or correlate to the total score awarded for the quiz and to the other items in the quiz.
The corrected item-total correlation coefficient is the value of the Pearson correlation obtained when an item score is correlated with the total score of the quiz from which that item is contained. The correction to that value comes in when the item being correlated is removed from the calculated total score to remove bias; accounting for an item only once rather than twice in the metric. Modern measurement practitioners (i.e. psychometricians and assessment evaluation experts) tend to use this metric more often than the discrimination index due to the fact that it incorporates the entire score scale rather than focusing only on the highest and lowest values in the score range.
Essentially, this metric helps determine if the students who are answering the item correctly (or scoring higher on an item than other students) tend to be the individuals who score higher on the rest of the quiz. Or conversely, showing if those who perform poorly on an item tend also to not do as well on the rest of the quiz.
The corrected item-total score correlation coefficient is calculated by dividing the covariance of the item score and the test score (minus the item in question; the corrected total score) by the product of the standard deviation of the item and the standard deviation of the corrected total score:
Corrected Item-total Correlation Coefficient Formula
where cov (item, corrected total score) is the covariance of the item and the corrected total score:
cov(item, corrected total score) = 𝑛∑(item)(corrected total score - (∑ item)(∑ corrected total score)
This value, like other correlation coefficients, ranges from -1 to +1. Ideally, items should aim to obtain values greater than or equal to +.20. Values near 0 indicate little to no relationship between item performance and performance on the rest of the test. Negative values are indicative of unexpected behavior (e.g. those who do well on an item tend to score lower on the rest of the quiz and vice versa). In a sense, this metric is considered a more comprehensive and sensitive measure of discrimination.
The discrimination index is focused on how well an item differentiates between the highest and lowest scoring individuals. It ranges from -1 to +1. A higher value suggests good discrimination while a lower (or negative) value indicates poor discrimination.
To calculate the discrimination index, the students who took the quiz rank percentile ranks based on the scores are calculated, and students are then classified into 3 groups: Students at or below the 27th percentile, students at or above the 63rd percentile, and everyone in between. Item difficulty (p value) is calculated for the upper and lower groups. The discrimination is the difference between the upper group item difficulty and the lower group difficulty.
Similar to the corrected item-total correlation coefficient, a high discrimination index indicates that the individuals who perform well on the test tend to perform well on the particular item. A lower discrimination index value means the item is not discriminating well. A negative number means there is a reversed/unexpected relationship. Thresholds for value ranges vary, but a general set of guidelines is:
Discrimination index |
Interpretation |
0.40 and above |
Very good discrimination |
0.30 - 0.39 |
Good discrimination |
0.20 - 0.29 |
Fair discrimination |
0.10 - 0.19 |
Not discriminating |
Below 0.10 |
Poor item |
Negative |
Reversed relationship |
The CSV file for New Quizzes’ Quiz and Item Analysis report includes the same information as you can see in Canvas interface.
Notes:
The CSV file name is the quiz title and “Quiz and Item Analysis Report” string.
The first nine columns are reserved for the quiz analysis and only one row is filled.
The column headings are as follows:
ReportGenerated: Date and time when the report was generated
QuizTitle: Title of the quiz
QuizHighScore: High score
QuizLowScore: Low score
QuizMeanScore: Mean score
QuizMedianScore: Median Score
QuizStandardDeviation: Standard Deviation
QuizCronbachsAlpha: Cronbach’s Alpha
QuizMeanElapsedTime: Mean Elapsed Time
From column ten to the end, the first row is always empty. Then each row represents one item in the quiz.
The column headings are as follows:
ItemID: ID of the quiz item
Title: Title of the item
ItemDifficulty: Item Difficulty
PossiblePoints: Maximum Points Possible
MeanEarnedPoints: Mean Earned Points
MedianEarnedPoints: Median Earned Points
DiscriminationIndex: Discrimination Index
CorrectedItemTotalCorrelation: Corrected Item Total Correlation Coefficient
ItemType: Question Type
Correct: Number of students who answered the item correctly
Incorrect: Number of students who answered the item incorrectly
NoResponse: Number of students who didn’t answer the item
AnswerFrequencies: Representation of the Answer Frequency Summary table
The Answer Frequency Summary table is represented in JSON (JavaScript Object Notation) objects due to the complexity of the data. Learn more about JSON.
The following JSON object is a representation of a categorization question:
{
"answers": [
{
"answer": "Sunglasses",
"categories": [
{
"category": "_distractors_",
"count": 4,
"correct": true
},
{
"category": "Essentials",
"count": 1,
"correct": false
},
{
"category": "Add-ons",
"count": 1,
"correct": false
}
]
},
{
"answer": "Light source",
"categories": [
{
"category": "_distractors_",
"count": 1,
"correct": false
},
{
"category": "Essentials",
"count": 2,
"correct": false
},
{
"category": "Add-ons",
"count": 3,
"correct": true
}
]
},
{
"answer": "Regulator",
"categories": [
{
"category": "_distractors_",
"count": 0,
"correct": false
},
{
"category": "Essentials",
"count": 5,
"correct": true
},
{
"category": "Add-ons",
"count": 1,
"correct": false
}
]
},
{
"answer": "Mask",
"categories": [
{
"category": "_distractors_",
"count": 0,
"correct": false
},
{
"category": "Essentials",
"count": 5,
"correct": true
},
{
"category": "Add-ons",
"count": 1,
"correct": false
}
]
}
]
}
The “answers” field is a list of objects.
Each answer has the same fields: the “answer” (the text of the answer) and “categories” (a list of objects).
A category object has three fields:
Note: You can see “category”: “_distractors_” at every answer object. This is for the Additional Distractors with a pre and postfix sign, to avoid confusion if you use the “Disctractors” name as one of your category in your question.
For reference: Link to New Quizzes End of Quarter Update Q4 - 2023
While the last quarter has allowed us to finish up the Item Analysis work including the CSV download, we’ve also been hard at work on two big features that don’t have a lot of flashy customer-facing changes, both of them bring value by increasing the portability of New Quizzes and giving greater control over sharing item banks to departments within an institution.
This quarter we will begin work to round out and enhance the setting to manage a students ability to view their results. While New Quizzes provides more granularity in what types of information students can view after their quiz attempt, the missing piece has to do with limiting that view by dates.
Looking forward on the roadmap, we will continue the portability work by making New Quizzes available to share through Canvas Commons and start planning out the API work for scoped endpoints and accommodations.
The Answer Frequency Summary table displays the number and percentage of students who selected each answer choice. The Answer Frequency Summary shows the total number of correct responses, incorrect responses, and no responses for the following question types: Categorization, Formula, Hot Spot, Matching, and Ordering. The following question types have now been added: Fill in the Blank, Essay, File Upload, Numeric.
Here is an example of how the Answer Frequency Summary would appear for a numeric question:
Answer Frequency Summary for Numeric Question
For Essay and File Upload question types the table is called a Score Frequency Summary rather than Answer since there is only one answer that is scored. The information displayed shows the distribution of respondents per total point value and the percentage of correct, graded, incorrect, or no response.
Here is an example of how the Score Frequency Summary would appear for an Essay question:
Score Frequency Summary for Essay Question
Quiz and Item Analysis reports can be downloaded in CSV format, encompassing all metrics and Answer Frequency Summary tables accessible through the User Interface. With the CSV download, instructors are able to more efficiently share data for audit and review, compare different reports, or further analyze the data with third-party solutions. More information can be found in the release notes (2024-02-17).
This past quarter we were able to release to production the following small features related to the moderate page:
On the moderate page, instructors are able to toggle between viewing scores as percentages or raw points to give greater flexibility and alignment to grading systems. A configure icon was added in the score display column
Moderate View Score Toggle
From the View Log link for each student, the question position has been added for each answered question to make it easier for instructors to verify the question position as students answer them.
Moderate View Log with Question Position
We are nearing the end of development on the Common Cartridge work. While the workflow and user interface will not change when exporting as Common Cartridge and importing course content, the change is in the files that make up the export package. This change makes the export of New Quizzes more reliable when there are changes to the quizzes. Users will be able to use the export packages as backups for their data regardless of what happens to the original quizzes.
Please stay tuned for a more detailed blogpost on the technical make-up of these files in Q2 when we release to Beta environments in the next few weeks.
As this work is in its final stages of development, the outcomes side is currently in testing mode and the sub-account bank sharing work continues to plug along, we are still looking to release this functionality by the end of this quarter. At that time we will be publishing a blogpost to describe how outcomes can be aligned to individual questions in item banks and how we have expanded the functionality to share item banks by subaccount with a new sharing modal that allows users to search by subaccount.
We will begin planning out the work to manage students’ results view this month. While the main goal is to limit student view of correct answers between certain dates, after a certain date, or before a certain date, we are considering the settings to show correct answers only after the last attempt or once after each attempt.
Last September, we posted about New Quizzes Migration - Question Banks to Item Banks. We identified a known issue related to course files in item banks. Copying a course does not automatically change the links in an item bank, so when you use a question from an item bank in the new course, the links would still refer back to the original course. The current workaround is as follows:
If someone wants to put an image in item bank content (as part of a question), they are either loading it from their user files or from their course files. If they are loading the image from their own user files, as long as they set a user file as readable, then the links will work in item banks when they copy a course. A warning appears only if it is course linked content, so if they remove it as a course file and move to a user file then the warning should not come up. Once they move the file over to their user files. They will need to delete the old link to the course file and re-insert the new link to the user file the way they would normally insert a link with the Rich Content Editor in the question.
The bigger picture around this issue is that this work entails improving Canvas file handling to allow for better support of files not directly associated with a single course or user such as those that are in use by item banks. We consider this a top priority as we work to optimize the capabilities of item banks and the portability of quizzes. As senior engineering leadership is discussing the work, please stay tuned for an update once they have a plan for a path forward.
Here is a list of the related fixes or features that we completed in the past quarter:
When looking at the quiz statistics, an instructor should easily be able to tell the spread of answers for a quiz question to know how to tailor learning. In multiple choice, you see how many learners (and who) chose each option, informing teaching strategy. For numeric questions, it shows the number of people with the exact correct answer, and the number of 'other answers', which is not helpful in quickly assessing classroom mastery. If the numeric question has a margin of error, some of those 'other answers' may also be correct, skewing the results unfavorably. A possible workaround is the item analysis report, but this report does not populate for numerical questions, so there is no meaningful way to analyze the effectiveness of these questions or see class understanding at a glance (or even at more than a glance, since the report doesn't help either).
Problem: there can be all sorts of answers, obviously we can't list every possible answer a student typed in the box and list how many students chose it, the list could become uselessly long and bog down loading of the page
Five categories for each numeric question with margin of error, three for numeric questions without.
For with margin of error:
1. Lower than range
2. Lower, but in range
3. Correct
4. Higher, but in range
5. Higher, but out of range
For straight numeric -
Lower than range
Correct
Higher than range
This gives a limited number of easy to predict options, while still giving teachers significant insight into how their students are performing at a glance. In many cases, the direction that a student is incorrect is just as important as that it was incorrect. This would bring numeric quiz statistics into line with the insights able to be gleaned from other question types from the quick view of the quiz statistics page.
admin
I recently attended a webinar called “Student Device Preferences for Online Course Access and Multimedia Learning”, and it tied in nicely to my presentation from this past summer about using mobile devices to increase student engagement in the online classroom. The research that was completed at Oregon State University’s Ecampus has some interesting results from its 2035 respondents such as . . .
I am inferring from the study too that students seem to understand that the Laptop and Desktop are more effective; however, they would prefer a mobile device such as a tablet or smartphone for the convenience and perhaps ease of use.
I am not sure that this is overwhelmingly new research in this study, but it does seem to be a nice reference as it is recent research and a leading online program. Perhaps more mobile learning environments will be created in the future to accommodate the preference. If you would like to learn more about the study, please refer to the attached PDF or Oregon State's Ecampus reasearch team.
I have been asked to share this research, and I welcome any feedback.
To interact with Panda Bot in the Instructure Community, you need to sign up or log in:
Sign In