Search the Community
HeatherAhern
in
Engineers are currently investigating the issue.
Description
When adding outcomes to a question in an existing New Quiz, the checkboxes for the outcomes are not clickable.
Expected Behavior
Assigning outcomes works correctly.
Workaround
-
Minimizing Options will allow users to progress correctly
-
Editing other questions before assigning outcomes will bypass the issue
-
Adding outcomes when the question is first created will bypass the issue
Steps to Reproduce
-
Create Course
-
Create Outcomes
-
Create New Quiz with any question type
-
Edit quiz and question to add Outcome to question
-
Note that when you click the checkbox it is unresponsive
Additional Info
QUIZ-15302
Known issues indicate notable behaviors that have been escalated to the Canvas engineering team. Known issues are not a guarantee for an immediate resolution. This document is for informational purposes only and does not replace the Support process. If you are encountering the behavior outlined in this document, please ensure you have submitted a Support case (per your institution's escalation process) so Canvas Support can adequately gauge the overall customer impact and prioritize appropriately.
ctitmus
in
Outcomes allow the administration and faculty to track mastery in a course. Users can import Account, State, and Common Core Standards into an account and course.
Account or Course Outcomes
Outcomes enables the administration and faculty to track students’ progress as measured by pedagogical goals or desired outcomes.
Assessments created to test student knowledge or to require students to demonstrate a specific skill resulting from a learning activity can be aligned to learning outcomes using rubrics (which can be used for grading simultaneously).
Grading student work automatically collects and compiles data on student progress for the Outcomes. The data is available for reporting to support teaching improvement, identify at-risk students, and support the accreditation process. This unified, streamlined approach dramatically reduces the amount of work required to implement Learning Outcomes through the intelligent reuse of assessment workflows in the grading process.
When would I use Outcomes?
Use Outcomes to:
- Focus students' attention on the most important skills and activities in your course (find existing outcomes or create new ones)
- Align Quizzes and Assignments to different kinds of mastery
- Run reports at the account-level about student artifacts of learning mastery
- Assess student progress through calculation methods
- Track student progress on a learning outcome or overall in the Learning Mastery Gradebook
- Align accreditation or other core standards to programs of study, courses, or student assessments
Calculation Methods
When users create an outcome, users can set one of four calculation methods used for student mastery: Weighted Average, Decaying Average, n Number of Times, Most Recent Score, and Highest Score. Calculation methods are used in conjunction within the Learning Mastery Gradebook.
Calculation methods can be set when creating custom course outcomes (instructors) or creating custom account outcomes (admins).
Notes:
- For new Outcomes created in the Canvas interface, the default calculation is Weighted Average unless changed to another calculation.
- For new Outcomes created using the Outcomes API, the default calculation is set as Highest Score but can be modified with the appropriate parameters.
- If a user imports an outcome but does not have permission to modify the calculation method, the calculation method cannot be changed.
- Common Core outcomes are always calculated as Highest Score; however, the calculation method can be modified using the Outcomes API by any user with appropriate admin permissions.
Weighted Average
The Weighted Average calculation factors the average of all assessment items while weighing the most recent (current) submission to any assignment associated with this outcome at a higher percentage.
By default, the Canvas weighted average is set at 65/35, meaning the current item is weighted at 65%, and the average of all other user scores is weighted at 35%. However, users can specify between 1% and 99% for the current percentage, and prior scores are weighted against the percentage difference. Note that the average is rounded to the next two decimals. If there is only one result, then the single score will be displayed.
For example, a student has four aligned items with scores of 4, 3, 2, and 5 (scores listed chronologically from oldest to most recent). If the current item is set to be weighted at 65% of mastery, prior scores are weighted at 35%:
- Current item score: 5
- Average of prior item scores: (4 + 3 + 2) / 3 = 3
- Calculated score: 5 (.65) + 3 (.35) = 3.25 + 1.05 = 4.3
Decaying Average
The Decaying Average calculation uses a formula to determine proficiency based on students' average scores, giving more weight to the most recent scored. To determine the weight given to the most recent score, the formula uses a decay rate. The higher the formula's decay rate, the more heavily the most recent assessment is weighted.
By default, the decay weight is set at 65%. However, you can adjust the rate to any percentage between 50% and 99%. Between two assessments, the most recent assessment gets 65% weight and the first gets 35%. For each additional assessment, the sum of the previous score calculations decay by an additional 35%.
For example, a student has scores of 1, 2, 3, 4 (scores listed chronologically from oldest to most recent):
(1 × .35) + (2 × .65) = X
(X × .35) + (3 × .65) = Y
(Y × .35) + (4 × .65) = Z (this being the current standard score; 3.48)
n Number of Times
The n Number of Times calculation requires a specific number of times that mastery must be met or exceeded, and the number of aligned items that must be completed for calculation eligibility. Any scores that do not meet mastery are not part of the calculation.
Users can specify between 1 and 10 items required for mastery.
For example, a student is required to achieve mastery 2 times with a mastery score of 5. If the student has scores of 1, 3, 2, 4, 5, 3, and 6, only the scores of 5 and 6 would be part of the calculation.
- Average score of eligible items: 5 + 6 = 11
- Calculated score: 11 / 2 = 5.5
Most Recent Score
The Most Recent Score calculation always selects the most recent score for all assessment items.
Highest Score
The Highest Score calculation always selects the highest score for all assessment items.
Select Average
To select the average score from all assessment items, select the Average option [1].
You can view an example of the Average calculation in the Example section [2].
Note: Average is not a good fit for most outcomes-based or mastery-based learning use cases because students may need time to reach mastery of an outcome and early poorer performance can bring down an average.
Outcome Mastery Scales
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery scales for the entire account.
Learn more about mastery scales in an account or in a course.
Outcome Mastery Calculations
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery calculations for the entire account.
Learn more about mastery calculations in an account or in a course.
Improved Outcomes Management
If the Account and Course Level Outcome Mastery Scales feature option and the Improved Outcomes Management feature option are enabled for your account, the Outcomes page displays an improved interface for viewing and managing outcomes.
Learn more about the Improved Outcomes Management in an account or in a course.
ctitmus
in
Outcomes are used to track mastery in a course. From the outcomes page, you can create and manage outcomes, create outcome groups, import outcomes, and manage rubrics.
This lesson displays how to use the Outcomes page in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes
On the outcomes page, you can create a new outcome [1], create a new outcome group [2], and find an outcome [3]. If you have permission, you can import an outcome [4].
To view details about an outcome group, click the name of the outcome group [5].
To view an outcome, click the name of the outcome [6].
View Outcome
To view an outcome, click the name of the outcome [1].
You can view the outcome description [2], criterion rating [3], points needed for mastery [4], calculation method [5], and calculation method explanation [6].
To view items aligned with the outcome and outcome artifacts, click the outcome title [7].
Note: If mastery scales and calculation methods do not display for your outcome, your institution has enabled course-wide mastery scales and calculation methods.
Manage Outcome and Outcome Group
You can move [1], edit [2], or delete [3] an outcome or outcome group.
Note: You cannot delete an outcome that has been used to assess students.
View Student View
To view the outcomes index page as a student, click the View as Student button.
Note: If the course navigation link for the page is disabled and hidden from students, the View as Student button does not display.
ctitmus
in
You can bulk import outcomes for your course using a CSV file. A bulk import allows you to add new outcomes to your course or update the details of multiple outcomes at one time.
The CSV file must be formatted correctly according to the Outcomes Import Format Documentation. Download a sample outcomes.csv file with one outcome group and six outcomes.
After your CSV file has been processed, you will receive an email notification confirming a successful import or displaying errors with your file. If there were errors, the email will contain details about the first 100 errors including the row of the error and a short description.
This lesson displays how to import outcomes in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to import outcomes in a course within an account that has enabled the Improved Outcomes Management feature option.
Notes:
- Currently, only CSV files are supported. JSON files will be supported in a future release.
- Importing outcomes is a course permission. If you do not have permission to import outcomes, your institution has restricted this feature.
- In new outcomes, the vendor_guid field must not contain a colon.
Open Outcomes
In Course Navigation, click the Outcomes link.
Import Outcomes
Click the Import button.
Upload File
Drag and drop your CSV file to the upload area, or click in the upload area to choose a file from your computer.
Open File
Locate the CSV file [1] and then click the Open button [2].
View Import Status
Canvas displays a loading page while the file uploads. Large CSV files may take time to import. You can leave the Outcomes page at any time without disrupting the import process.
View Import Success
When the file has been successfully imported, Canvas displays a confirmation message. You will also receive an email that the import was successful.
View Import Errors and Warnings
If the import was not successful, or if the import altered existing outcomes, Canvas displays an error message.
The error message displays for outcome import errors and for outcome import warnings.
You will receive an email with details about the first 100 errors and warnings. Each error or warning will include the CSV row number and a description of the error or warning.
Import errors stop the import process entirely and need to be fixed before outcomes can be imported successfully. The following types of errors may occur in CSV files:
- Required headings are missing
- Other headings are placed after the ratings header
- Invalid headers are present
- Required fields are missing
- Import file contains no data
- Invalid UTF-8 string
When an import warning occurs, Canvas skips the affected row and the import moves on. The following types of warnings may occur in CSV files:
- Rating tiers have missing points
- Rating tiers have invalid point values
- Rating tiers have points in wrong order
- Object type is incorrect
- Parent group refers to missing outcomes
- Parent groups are invalid
- Workflow state is invalid
- Calculation validation method not specified
- Group receives invalid fields
- Outcome edits are not within the same context
Correct the errors in the CSV file according to the Outcomes Import Format Documentation and re-import the file.
View Outcomes
View the outcomes imported into your course.
Naomi
in
You can view course content items aligned with a specific outcome.
Open Outcomes
In Course Navigation, click the Outcomes link.
Open Alignments
Click the Alignments tab.
Open Outcome
In the All Outcomes drop-down menu [1], you can view all outcomes [2], outcomes with alignments [3] or outcomes without alignments [4].
Click the expand arrow next to the outcome you want to view [5].
View Alignments
View the course content items aligned to the outcome and the module in which they are located, if applicable.
Aligned items are identified with an icon displaying the item type: assignment [1] or rubric [2].
You can view the number of course content items aligned to an outcome [3].
ctitmus
in
You can view outcome reports for all students in your course. For each student, you can view the overview of all outcomes and artifacts, the number of student attempts, latest score, and average percentage.
Open People
In Course Navigation, click the People link.
Locate User
In the search field [1], search for the name of the user. You can also filter users by role in the Roles drop-down menu [2].
Open User Details
Click the user's Options icon [1], then select the User Details link [2].
Open Outcomes Report
Locate the user details sidebar. Depending on the page display, click the Outcomes Report link or button.
View Report
View the report.
ctitmus
in
Outcomes are used to track mastery in a course. From the Outcomes page, you can create and manage outcomes, create and manage outcome groups, and import outcomes.
This lesson displays how to use the Outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in the classic Outcomes page view.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes Page
The Outcomes page opens to the Manage tab [1]. From the Manage tab, you can view and manage outcomes and outcome groups.
To view and manage outcome mastery scales in a course, click the Mastery tab [2].
To view and manage outcome mastery calculations in a course, click the Calculation tab [3].
To view aligned items in a course, click the Alignments tab [4].
To import outcomes into your course, click the Import button [5].
To create a new outcome, click the Create button [6].
To find an outcome to add to your course, click the Find button [7].
View Outcome Groups
From the Outcome Groups window, you can view all the outcome groups in your course [1].
To view an outcome group, click the name of the group [2]. Any outcome groups nested within that group display below the primary group [3]. Outcome group details, including all outcomes that belong to the group, display in the Outcomes window [4].
To create a new outcome group, click a Create New Group link [5]. Outcome groups can be created at the course level or within another outcome group.
You can adjust the size of the Outcome Groups and Outcomes windows by clicking and dragging the divider bar [6].
View Outcome Group Settings
To view the Settings menu for an outcome group, click the Settings icon [1].
To edit an outcome group, click the Edit link [2].
To remove an outcome from your course, click the Remove link [3].
To move an outcome group, click the Move link [4].
To add outcomes, click the Add Outcomes link [5].
To import outcomes, click the Import Outcomes link [6].
To view the description for an outcome group, click the View Description link [7].
View Outcomes
When you select an outcome group, all outcomes in that group display in the Outcomes window [1]. The window displays the number of outcomes in the group [2].
To search for an outcome, enter the outcome name in the Search field [3].
Each outcome displays its name [4] and description [5]. To view more description text, click the Expand icon [6].
To remove or move multiple outcomes, click the checkboxes for the outcomes [7]. The Outcomes window displays the number of outcomes selected in the Outcomes Selected link [8]. To view the names of the outcomes selected, click the Outcomes Selected link.
To remove multiple outcomes from the course, click the Remove button [9]. To move multiple outcomes, click the Move button [10].
View Outcome Settings
To view the Settings menu for an outcome, click the Settings icon [1].
To edit the outcome, click the Edit link [2].
To view the assignments aligned to the outcome, click the Alignments link [3].
To move the outcome, click the Move link [4].
To remove the outcome from the course, click the Remove link [5].
View Student View
To view the Outcomes page as a student, click the Student View button.
Note: If the course navigation link for the page is disabled and hidden from students, the Student View button does not display.
InstContentTeam
in
In this video, you will learn how to create, search for, and manage outcomes at the course level. You will also learn how to link them to student learning mastery.
Last updated 2023-06-02
View the script for this video
To view subtitles for this video, click the 
Video overviews reflect current feature functionality in Canvas; they are updated based on workflow changes, not on minor or non-functional interface enhancements. Depending on your institution's Canvas theme, the Canvas interface may display differently than shown in this video, but the functionality is the same.
Outcomes Overview Video Script
In this video, you will learn how to create, search for, and manage outcomes at the course level. You will also learn how to link them to student learning mastery.
You can add outcomes created at an institution or account-level (like state learning standards or Common Core Standards), or you can create them yourself at the course-level. You can then align outcomes to assignment rubrics and quiz question banks to assess student learning.
Click Outcomes in Course Navigation to view your outcomes. From the Outcomes Index page you can create and manage outcomes for your course. The first pane displays a list of all outcome groups and ungrouped outcomes for your course. To view the outcomes within a group, click the group name. Then view the outcome’s details by clicking the outcome name in the second pane.
You can delete an outcome or outcome group by clicking the Delete Outcome button. You can also edit the outcome by clicking the Edit Outcome button. You also have the option to move the outcome to and from outcome groups by either clicking the Move Outcome button or by manually dragging and dropping the outcome.
You can add existing outcomes by clicking the Find button. If your institution has already added outcomes you will see them in an Account group. You can browse available outcomes and you can import individual outcomes or outcome groups. Highlight the desired outcome or group and click the Import button. Use the side-to-side scroll bar or click the Back button to return to the top-level Outcomes.
To add a new Outcome Group, click the New Group button. Type a name for your outcome group in the New Outcome Group field. Then, type a description for the group using the Rich Content Editor. Click the Save button to create the group.
To create a new Outcome, select the appropriate outcome group, and click the New Outcome button. Enter the name of the outcome. You can also enter a Friendly Name, which is the outcome name that students will see when viewing their grades. Then, enter a description for the outcome using the Rich Content Editor. Edit the criterion ratings by clicking the edit icon in the appropriate criteria. You can then change the name and point value by typing in the text fields. Delete the criteria by clicking the Delete button. Click Ok to save the new criteria. Add additional criterion ratings by clicking the Insert link and entering the information. Type in the point value necessary to master the learning outcome in the Mastery at: field. You can then specify one of four calculation methods used for student mastery. Available calculation methods include Decaying Average, n Number of Times, Most recent Score, and Highest Score. Click the Save button to create the Outcome.
Additionally, you can import outcomes using a CSV file. Click the Import button and select your file to start the upload. Once you've created outcomes, you can begin aligning them with different activities or assignments within your course. When creating or editing a rubric, you can add outcomes to your rubric using the Find Outcomes link. When you find an outcome you would like to align with the rubric, you have the option to Use the Criterion for Scoring. If you want the outcome criterion to be part of the total point value of the assignment, make sure the checkbox is marked. Outcome criteria are indicated by the outcomes icon in the rubric. Attach the Rubric to an assignment to communicate expectations and to assess student learning.
If you have enabled the Learning Mastery Gradebook in your course, you can view outcome assessment data to assess student learning . Click Grades in Course Navigation and select the Learning Mastery Gradebook view. The sidebar displays scoring information and options to modify the Learning Mastery Gradebook view. To exclude outcomes or students with no outcomes results from the view, select the applicable checkbox. Hover over the outcome name to view the outcome details and a summary of the scores in the course.
You've now completed this tutorial video on Outcomes. For additional information on this or any other topic about Canvas, please visit guides.canvaslms.com. You can also ask questions and engage with other Canvas users by visiting community.canvaslms.com.
ctitmus
in
The Learning Mastery Gradebook Individual View allows instructors to assess one student and one outcome at a time. Fully accessible to screen readers, this Gradebook view allows instructors to sort by section and outcome and contains all the same settings that are available in the Learning Mastery Gradebook Default View (the view that shows all students in a course).
If you are not familiar with the settings and other options in the Learning Mastery Gradebook, click the feature links throughout this lesson to learn more about how the feature works in Default View.
Like all Gradebook tabs, Individual View is persistent. Therefore, once you switch the Gradebook to Individual View, the Gradebook will always display in Individual View until it is switched back to Default View.
Open Gradebook
In Course Navigation, click the Grades link.
Switch to Individual Gradebook
Click the Learning Mastery Gradebook menu [1] and then click the Individual Gradebook link [2].
Note: Select the Learning Mastery Gradebook if it is not already displayed. Otherwise, the Individual View will display assignments and not outcomes.
Select a Section
In the section drop-down menu, select the section you want to view.
Hide Student Names
To hide student names in the Gradebook Individual View, select the Hide Student Names checkbox [1]. To download scores in a CSV file, click the Download Results button [2].
Select Student
In the Student drop-down menu [1], select the name of the student whose information you want to view. If you want to view all students beginning with the first student in your course or section, click the Next Student button [2].
Remember, student names will be sorted by last name and displayed according to your section preference in the Global Settings drop-down menu.
Select Outcome
In the Assignment drop-down menu [1], select the outcome you want to view. If you want to view the first outcome in your course, click the Next Outcome button [2].
View Gradebook Information
Once you select a student and an outcome, the Result, Student Information, and Outcome Information will display all corresponding content. Scroll down the page to view each of these sections. You can revisit the Gradebook settings at any time to hide and show settings.
View Next Student or Outcome
To view the next student, click the Next Student button [1].
To view the next outcome, click the Next Outcome button [2].
You can always select individual students and/or outcomes by clicking each respective drop-down menu.
Switch Gradebooks
To switch to the Default Learning Mastery Gradebook, click the Individual Gradebook menu [1] and click the Learning Mastery Gradebook link [2].
swynn
in
Engineers are currently investigating the issue.
Description
When a New Quiz or New Quiz question has an outcome attached, and the quiz and outcomes are imported to another course, the Outcome Analysis Report will show the message "There is no report here to show. The assessment has no outcomes aligned to it. Go to the Build tab to align outcomes."
Expected Behavior
The report should show the "Looks like you're a little early. Students must finish the assessment before any outcome results will show here. Check back here after some students have completed the assessment." message as it does in the original course.
Workaround
No workaround exists at this time.
Steps to Reproduce
-
Create an outcome. Create a New Quiz. Add outcome to the quiz or question in the quiz.
-
Copy the quiz and outcome to a new course.
-
Go to the Outcomes Analysis for the quiz in the new course.
Additional Info
OUT-6090
Known issues indicate notable behaviors that has been escalated to the Canvas engineering team. Known issues are not a guarantee for an immediate resolution. This document is for informational purposes only and does not replace the Support process. If you are encountering the behavior outlined in this document, please ensure you have submitted a Support case (per your institution's escalation process) so Canvas Support can adequately gauge the overall customer impact and prioritize appropriately.
