Search the Community
Engineers are currently investigating the issue.
Description
When a New Quiz or New Quiz question has an outcome attached, and the quiz and outcomes are imported to another course, the Outcome Analysis Report will show the message "There is no report here to show. The assessment has no outcomes aligned to it. Go to the Build tab to align outcomes."
Expected Behavior
The report should show the "Looks like you're a little early. Students must finish the assessment before any outcome results will show here. Check back here after some students have completed the assessment." message as it does in the original course.
Workaround
No workaround exists at this time.
Steps to Reproduce
-
Create an outcome. Create a New Quiz. Add outcome to the quiz or question in the quiz.
-
Copy the quiz and outcome to a new course.
-
Go to the Outcomes Analysis for the quiz in the new course.
Additional Info
OUT-6090
Known issues indicate notable behaviors that has been escalated to the Canvas engineering team. Known issues are not a guarantee for an immediate resolution. This document is for informational purposes only and does not replace the Support process. If you are encountering the behavior outlined in this document, please ensure you have submitted a Support case (per your institution's escalation process) so Canvas Support can adequately gauge the overall customer impact and prioritize appropriately.
- Tags:
- OUT-6090
Outcomes allow the administration and faculty to track mastery in a course. Users can import Account, State, and Common Core Standards into an account and course.
Account or Course Outcomes
Outcomes enables the administration and faculty to track students’ progress as measured by pedagogical goals or desired outcomes.
Assessments created to test student knowledge or to require students to demonstrate a specific skill resulting from a learning activity can be aligned to learning outcomes using rubrics (which can be used for grading simultaneously).
Grading student work automatically collects and compiles data on student progress for the Outcomes. The data is available for reporting to support teaching improvement, identify at-risk students, and support the accreditation process. This unified, streamlined approach dramatically reduces the amount of work required to implement Learning Outcomes through the intelligent reuse of assessment workflows in the grading process.
When would I use Outcomes?
Use Outcomes to:
- Focus students' attention on the most important skills and activities in your course (find existing outcomes or create new ones)
- Align Quizzes and Assignments to different kinds of mastery
- Run reports at the account-level about student artifacts of learning mastery
- Assess student progress through calculation methods
- Track student progress on a learning outcome or overall in the Learning Mastery Gradebook
- Align accreditation or other core standards to programs of study, courses, or student assessments
Calculation Methods
When users create an outcome, users can set one of four calculation methods used for student mastery: Weighted Average, Decaying Average, n Number of Times, Most Recent Score, and Highest Score. Calculation methods are used in conjunction within the Learning Mastery Gradebook.
Calculation methods can be set when creating custom course outcomes (instructors) or creating custom account outcomes (admins).
Notes:
- For new Outcomes created in the Canvas interface, the default calculation is Weighted Average unless changed to another calculation.
- For new Outcomes created using the Outcomes API, the default calculation is set as Highest Score but can be modified with the appropriate parameters.
- If a user imports an outcome but does not have permission to modify the calculation method, the calculation method cannot be changed.
- Common Core outcomes are always calculated as Highest Score; however, the calculation method can be modified using the Outcomes API by any user with appropriate admin permissions.
Weighted Average
The Weighted Average calculation factors the average of all assessment items while weighing the most recent (current) submission to any assignment associated with this outcome at a higher percentage.
By default, the Canvas weighted average is set at 65/35, meaning the current item is weighted at 65%, and the average of all other user scores is weighted at 35%. However, users can specify between 1% and 99% for the current percentage, and prior scores are weighted against the percentage difference. Note that the average is rounded to the next two decimals. If there is only one result, then the single score will be displayed.
For example, a student has four aligned items with scores of 4, 3, 2, and 5 (scores listed chronologically from oldest to most recent). If the current item is set to be weighted at 65% of mastery, prior scores are weighted at 35%:
- Current item score: 5
- Average of prior item scores: (4 + 3 + 2) / 3 = 3
- Calculated score: 5 (.65) + 3 (.35) = 3.25 + 1.05 = 4.3
Decaying Average
The Decaying Average calculation uses a formula to determine proficiency based on students' average scores, giving more weight to the most recent scored. To determine the weight given to the most recent score, the formula uses a decay rate. The higher the formula's decay rate, the more heavily the most recent assessment is weighted.
By default, the decay weight is set at 65%. However, you can adjust the rate to any percentage between 50% and 99%. Between two assessments, the most recent assessment gets 65% weight and the first gets 35%. For each additional assessment, the sum of the previous score calculations decay by an additional 35%.
For example, a student has scores of 1, 2, 3, 4 (scores listed chronologically from oldest to most recent):
(1 × .35) + (2 × .65) = X
(X × .35) + (3 × .65) = Y
(Y × .35) + (4 × .65) = Z (this being the current standard score; 3.48)
n Number of Times
The n Number of Times calculation requires a specific number of times that mastery must be met or exceeded, and the number of aligned items that must be completed for calculation eligibility. Any scores that do not meet mastery are not part of the calculation.
Users can specify between 1 and 10 items required for mastery.
For example, a student is required to achieve mastery 2 times with a mastery score of 5. If the student has scores of 1, 3, 2, 4, 5, 3, and 6, only the scores of 5 and 6 would be part of the calculation.
- Average score of eligible items: 5 + 6 = 11
- Calculated score: 11 / 2 = 5.5
Most Recent Score
The Most Recent Score calculation always selects the most recent score for all assessment items.
Highest Score
The Highest Score calculation always selects the highest score for all assessment items.
Select Average
To select the average score from all assessment items, select the Average option [1].
You can view an example of the Average calculation in the Example section [2].
Note: Average is not a good fit for most outcomes-based or mastery-based learning use cases because students may need time to reach mastery of an outcome and early poorer performance can bring down an average.
Outcome Mastery Scales
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery scales for the entire account.
Learn more about mastery scales in an account or in a course.
Outcome Mastery Calculations
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery calculations for the entire account.
Learn more about mastery calculations in an account or in a course.
Improved Outcomes Management
If the Account and Course Level Outcome Mastery Scales feature option and the Improved Outcomes Management feature option are enabled for your account, the Outcomes page displays an improved interface for viewing and managing outcomes.
Learn more about the Improved Outcomes Management in an account or in a course.
Outcomes are used to track mastery in a course. From the outcomes page, you can create and manage outcomes, create outcome groups, import outcomes, and manage rubrics.
This lesson displays how to use the Outcomes page in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes
On the outcomes page, you can create a new outcome [1], create a new outcome group [2], and find an outcome [3]. If you have permission, you can import an outcome [4].
To view details about an outcome group, click the name of the outcome group [5].
To view an outcome, click the name of the outcome [6].
View Outcome
To view an outcome, click the name of the outcome [1].
You can view the outcome description [2], criterion rating [3], points needed for mastery [4], calculation method [5], and calculation method explanation [6].
To view items aligned with the outcome and outcome artifacts, click the outcome title [7].
Note: If mastery scales and calculation methods do not display for your outcome, your institution has enabled course-wide mastery scales and calculation methods.
Manage Outcome and Outcome Group
You can move [1], edit [2], or delete [3] an outcome or outcome group.
Note: You cannot delete an outcome that has been used to assess students.
You can view course content items aligned with a specific outcome.
Open Outcomes
In Course Navigation, click the Outcomes link.
Open Outcome
In the All Outcomes drop-down menu [1], you can view all outcomes [2], outcomes with alignments [3] or outcomes without alignments [4].
Click the expand arrow next to the outcome you want to view [5].
You can bulk import outcomes for your course using a CSV file. A bulk import allows you to add new outcomes to your course or update the details of multiple outcomes at one time.
The CSV file must be formatted correctly according to the Outcomes Import Format Documentation. Download a sample outcomes.csv file with one outcome group and six outcomes.
After your CSV file has been processed, you will receive an email notification confirming a successful import or displaying errors with your file. If there were errors, the email will contain details about the first 100 errors including the row of the error and a short description.
This lesson displays how to import outcomes in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to import outcomes in a course within an account that has enabled the Improved Outcomes Management feature option.
Notes:
- Currently, only CSV files are supported. JSON files will be supported in a future release.
- Importing outcomes is a course permission. If you do not have permission to import outcomes, your institution has restricted this feature.
- In new outcomes, the vendor_guid field must not contain a colon.
Open Outcomes
In Course Navigation, click the Outcomes link.
Import Outcomes
Click the Import button.
Upload File
Drag and drop your CSV file to the upload area, or click in the upload area to choose a file from your computer.
Open File
Locate the CSV file [1] and then click the Open button [2].
View Import Status
Canvas displays a loading page while the file uploads. Large CSV files may take time to import. You can leave the Outcomes page at any time without disrupting the import process.
View Import Success
When the file has been successfully imported, Canvas displays a confirmation message. You will also receive an email that the import was successful.
View Import Errors and Warnings
If the import was not successful, or if the import altered existing outcomes, Canvas displays an error message.
The error message displays for outcome import errors and for outcome import warnings.
You will receive an email with details about the first 100 errors and warnings. Each error or warning will include the CSV row number and a description of the error or warning.
Import errors stop the import process entirely and need to be fixed before outcomes can be imported successfully. The following types of errors may occur in CSV files:
- Required headings are missing
- Other headings are placed after the ratings header
- Invalid headers are present
- Required fields are missing
- Import file contains no data
- Invalid UTF-8 string
When an import warning occurs, Canvas skips the affected row and the import moves on. The following types of warnings may occur in CSV files:
- Rating tiers have missing points
- Rating tiers have invalid point values
- Rating tiers have points in wrong order
- Object type is incorrect
- Parent group refers to missing outcomes
- Parent groups are invalid
- Workflow state is invalid
- Calculation validation method not specified
- Group receives invalid fields
- Outcome edits are not within the same context
Correct the errors in the CSV file according to the Outcomes Import Format Documentation and re-import the file.
Outcomes are used to track mastery in a course. From the Outcomes page, you can create and manage outcomes, create and manage outcome groups, and import outcomes.
This lesson displays how to use the Outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in the classic Outcomes page view.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes Page
The Outcomes page opens to the Manage tab [1]. From the Manage tab, you can view and manage outcomes and outcome groups.
To view and manage outcome mastery scales in a course, click the Mastery tab [2].
To view and manage outcome mastery calculations in a course, click the Calculation tab [3].
To view aligned items in a course, click the Alignments tab [4].
To import outcomes into your course, click the Import button [5].
To create a new outcome, click the Create button [6].
To find an outcome to add to your course, click the Find button [7].
View Outcome Groups
From the Outcome Groups window, you can view all the outcome groups in your course [1].
To view an outcome group, click the name of the group [2]. Any outcome groups nested within that group display below the primary group [3]. Outcome group details, including all outcomes that belong to the group, display in the Outcomes window [4].
To create a new outcome group, click a Create New Group link [5]. Outcome groups can be created at the course level or within another outcome group.
You can adjust the size of the Outcome Groups and Outcomes windows by clicking and dragging the divider bar [6].
View Outcome Group Settings
To view the Settings menu for an outcome group, click the Settings icon [1].
To edit an outcome group, click the Edit link [2].
To remove an outcome from your course, click the Remove link [3].
To move an outcome group, click the Move link [4].
To add outcomes, click the Add Outcomes link [5].
To import outcomes, click the Import Outcomes link [6].
To view the description for an outcome group, click the View Description link [7].
View Outcomes
When you select an outcome group, all outcomes in that group display in the Outcomes window [1]. The window displays the number of outcomes in the group [2].
To search for an outcome, enter the outcome name in the Search field [3].
Each outcome displays its name [4] and description [5]. To view more description text, click the Expand icon [6].
To remove or move multiple outcomes, click the checkboxes for the outcomes [7]. The Outcomes window displays the number of outcomes selected in the Outcomes Selected link [8]. To view the names of the outcomes selected, click the Outcomes Selected link.
To remove multiple outcomes from the course, click the Remove button [9]. To move multiple outcomes, click the Move button [10].
View Outcome Settings
To view the Settings menu for an outcome, click the Settings icon [1].
To edit the outcome, click the Edit link [2].
To view the assignments aligned to the outcome, click the Alignments link [3].
To move the outcome, click the Move link [4].
To remove the outcome from the course, click the Remove link [5].
You can view outcome reports for all students in your course. For each student, you can view the overview of all outcomes and artifacts, the number of student attempts, latest score, and average percentage.
Open People
In Course Navigation, click the People link.
Locate User
In the search field [1], search for the name of the user. You can also filter users by role in the Roles drop-down menu [2].
Open Outcomes Report
Locate the user details sidebar. Depending on the page display, click the Outcomes Report link or button.
The Learning Mastery Gradebook Individual View allows instructors to assess one student and one outcome at a time. Fully accessible to screen readers, this Gradebook view allows instructors to sort by section and outcome and contains all the same settings that are available in the Learning Mastery Gradebook Default View (the view that shows all students in a course).
If you are not familiar with the settings and other options in the Learning Mastery Gradebook, click the feature links throughout this lesson to learn more about how the feature works in Default View.
Like all Gradebook tabs, Individual View is persistent. Therefore, once you switch the Gradebook to Individual View, the Gradebook will always display in Individual View until it is switched back to Default View.
Open Gradebook
In Course Navigation, click the Grades link.
Switch to Individual Gradebook
Click the Learning Mastery Gradebook menu [1] and then click the Individual Gradebook link [2].
Select a Section
In the section drop-down menu, select the section you want to view.
Hide Student Names
To hide student names in the Gradebook Individual View, select the Hide Student Names checkbox [1]. To download scores in a CSV file, click the Download Results button [2].
Select Student
In the Student drop-down menu [1], select the name of the student whose information you want to view. If you want to view all students beginning with the first student in your course or section, click the Next Student button [2].
Remember, student names will be sorted by last name and displayed according to your section preference in the Global Settings drop-down menu.
Select Outcome
In the Assignment drop-down menu [1], select the outcome you want to view. If you want to view the first outcome in your course, click the Next Outcome button [2].
View Gradebook Information
Once you select a student and an outcome, the Result, Student Information, and Outcome Information will display all corresponding content. Scroll down the page to view each of these sections. You can revisit the Gradebook settings at any time to hide and show settings.
View Next Student or Outcome
To view the next student, click the Next Student button [1].
To view the next outcome, click the Next Outcome button [2].
You can always select individual students and/or outcomes by clicking each respective drop-down menu.
Switch Gradebooks
To switch to the Default Learning Mastery Gradebook, click the Individual Gradebook menu [1] and click the Learning Mastery Gradebook link [2].
The Improved Outcomes Management feature option provides an improved user interface for managing outcomes in your account.
Outcomes are used to track mastery in an account or course. From the account outcomes page, you can create and manage outcomes, create outcome groups, import outcomes, and manage rubrics for an account.
Notes:
- If your Outcomes page looks different than this guide, your institution does not have the Improved Outcomes Management feature option enabled. Please refer to the Outcomes guides for more information.
- The Account and Course Level Outcome Mastery Scales feature option must also be enabled to set mastery scales and calculation methods.
Open Account
In Global Navigation, click the Admin link [1], then click the name of the account [2].
Open Outcomes
In Account Navigation, click the Outcomes link.
View Outcomes
On the Outcomes page, you can view and manage outcomes and outcomes groups [1], mastery scale settings [2], and calculation method settings [3].
To import an outcome, click the Import button [4].
To create a new outcome, click the Create button [5].
To find an outcome, including State and Common Core Standards, click the Find button [6].
View Outcome Group Options
To view options for managing outcomes groups, select an outcome group from the Outcome Groups sidebar [1].
In the Outcomes area, click the Options icon for the outcome group [2].
To edit the outcome group, click the Edit option [3].
To remove the outcome group and all outcomes within the group, click the Remove option [4].
To move the outcome group to another group, click the Move option [5].
To add outcomes, click the Add Outcomes option [6].
To import outcomes to the outcome group, click the Import Outcomes option [7].
To view the outcome group's description, click the View Description option [8].
View Outcome Options
To view options for managing an individual outcome, click the Options icon for the outcome [1].
To edit the outcome, click the Edit option [2].
To view the assignments aligned to the outcome, click the Alignments link [3].
To move the outcome to another outcome group, click the Move option [4].
To remove the outcome, click the Remove option [5]. If the outcome is already associated with assignments in your account, you will not be able to remove the outcome.
View Mastery Settings
To view the default mastery scale for all courses within your account, click the Mastery tab [1].
To set the mastery level in the scale, select the desired level in the Mastery column [2].
To add or modify the mastery level description, enter a description in the Description field [3].
To modify the point value associated with the mastery level, enter a point value in the Points field [4].
To change the color associated with the mastery level, click the Change link or color selector in the Color column [5].
To remove a mastery level from the scale, click the Remove icon for the level you want to remove [6].
To add a mastery level to the scale, click the Add Mastery Level button [7].
To save your changes to the mastery scale, click the Save Mastery Scale button [8].
View Calculation Settings
To view the default mastery calculation method for your account, click the Calculation tab [1].
To change the default mastery calculation method, select a method from the Mastery Calculation drop-down menu [2].
Some calculation methods may require additional settings.
To save the mastery calculation settings, click the Save Mastery Calculation button [3].
If you cannot find an outcome to use in your course, you can create a new outcome.
Outcomes can be included in assignment rubrics as an easy way to assess mastery of learning objectives. When you create a learning outcome, you should also define a criterion that can be used when building assignment rubrics. Define as many rubric columns as you need, and specify a point threshold that will be used to define mastery of this outcome.
This lesson displays how to create outcomes in a course within an account that has enabled the Improved Outcomes Management feature option. If the Outcomes page in your course displays differently than the images in this lesson, learn how to create outcomes in the classic Outcomes page view.
In order to use Improved Outcomes Management, you course must also use course-wide mastery scales and calculations. Because of this, you cannot add criterion ratings, mastery levels, and calculation methods for individual outcomes in Improved Outcomes Management.
Open Outcomes
In Course Navigation, click the Outcomes link.
Create Outcome
Enter a name for the outcome in the Name field [1]. This is the official name of the outcome that will also appear in the Learning Mastery Gradebook.
If you allow students to view Learning Mastery scores on the Grades page, they will see the name of the outcome. However, you may want to create a custom, friendly name. To create a friendly name for student view, enter a name in the Friendly Name field [2].
Use the Rich Content Editor to enter a description in the Description field [3]. To create a friendly description for parent or student view, enter a description in the Friendly Description field [4].
Modify Mastery Scale
If you have the permission to edit mastery scales, you can make changes to the default mastery scale in the Mastery tab.
Modify Mastery Calculation Method
If you have the permission to edit outcome proficiency calculations, you can make changes to calculation methods in the Calculation tab.