Search the Community
HeatherAhern
in
Engineers are currently investigating the issue.
Description
When a New Quiz has an outcome(s) attached to the quiz or questions in the quiz, and the quiz/outcome(s) are imported to a new course, they are not working in the new course. The outcomes in the new course don't show as being aligned to the quiz/question, outcome results are not updated to the Learning Mastery Gradebook, inside the quiz, the Outcome Analysis report shows the quiz as not having outcomes aligned.
Expected Behavior
When a New Quiz with outcomes is imported to a new course, the outcomes should function with the quiz in the copied course.
Workaround
No workaround exists at this time.
Steps to Reproduce
Prerequisites: Two courses, course A and course B, with one user enrolled as a teacher in both courses and a student in course B.
-
In course A, create an outcome, create a New Quiz, and attach the outcome to the quiz or question in the quiz.
-
Copy the quiz and outcome to course B (Copy a Canvas Course option in Course Import Tool in course B, select course A to copy, and copy all content).
-
In course B, check the outcome, you won't see alignments. Check the Outcome Analysis report, it appears no outcome is attached there. Take the quiz as a student in the course. Notice no data updates to the LMGB.
Additional Info
EGG-1534
Known issues indicate notable behaviors that have been escalated to the Canvas engineering team. Known issues are not a guarantee for an immediate resolution. This document is for informational purposes only and does not replace the Support process. If you are encountering the behavior outlined in this document, please ensure you have submitted a Support case (per your institution's escalation process) so Canvas Support can adequately gauge the overall customer impact and prioritize appropriately.
ctitmus
in
Outcomes allow the administration and faculty to track mastery in a course. Users can import Account, State, and Common Core Standards into an account and course.
Account or Course Outcomes
Outcomes enables the administration and faculty to track students’ progress as measured by pedagogical goals or desired outcomes.
Assessments created to test student knowledge or to require students to demonstrate a specific skill resulting from a learning activity can be aligned to learning outcomes using rubrics (which can be used for grading simultaneously).
Grading student work automatically collects and compiles data on student progress for the Outcomes. The data is available for reporting to support teaching improvement, identify at-risk students, and support the accreditation process. This unified, streamlined approach dramatically reduces the amount of work required to implement Learning Outcomes through the intelligent reuse of assessment workflows in the grading process.
When would I use Outcomes?
Use Outcomes to:
- Focus students' attention on the most important skills and activities in your course (find existing outcomes or create new ones)
- Align Quizzes and Assignments to different kinds of mastery
- Run reports at the account-level about student artifacts of learning mastery
- Assess student progress through calculation methods
- Track student progress on a learning outcome or overall in the Learning Mastery Gradebook
- Align accreditation or other core standards to programs of study, courses, or student assessments
Calculation Methods
When users create an outcome, users can set one of four calculation methods used for student mastery: Weighted Average, Decaying Average, n Number of Times, Most Recent Score, and Highest Score. Calculation methods are used in conjunction within the Learning Mastery Gradebook.
Calculation methods can be set when creating custom course outcomes (instructors) or creating custom account outcomes (admins).
Notes:
- For new Outcomes created in the Canvas interface, the default calculation is Weighted Average unless changed to another calculation.
- For new Outcomes created using the Outcomes API, the default calculation is set as Highest Score but can be modified with the appropriate parameters.
- If a user imports an outcome but does not have permission to modify the calculation method, the calculation method cannot be changed.
- Common Core outcomes are always calculated as Highest Score; however, the calculation method can be modified using the Outcomes API by any user with appropriate admin permissions.
Weighted Average
The Weighted Average calculation factors the average of all assessment items while weighing the most recent (current) submission to any assignment associated with this outcome at a higher percentage.
By default, the Canvas weighted average is set at 65/35, meaning the current item is weighted at 65%, and the average of all other user scores is weighted at 35%. However, users can specify between 1% and 99% for the current percentage, and prior scores are weighted against the percentage difference. Note that the average is rounded to the next two decimals. If there is only one result, then the single score will be displayed.
For example, a student has four aligned items with scores of 4, 3, 2, and 5 (scores listed chronologically from oldest to most recent). If the current item is set to be weighted at 65% of mastery, prior scores are weighted at 35%:
- Current item score: 5
- Average of prior item scores: (4 + 3 + 2) / 3 = 3
- Calculated score: 5 (.65) + 3 (.35) = 3.25 + 1.05 = 4.3
Decaying Average
The Decaying Average calculation uses a formula to determine proficiency based on students' average scores, giving more weight to the most recent scored. To determine the weight given to the most recent score, the formula uses a decay rate. The higher the formula's decay rate, the more heavily the most recent assessment is weighted.
By default, the decay weight is set at 65%. However, you can adjust the rate to any percentage between 50% and 99%. Between two assessments, the most recent assessment gets 65% weight and the first gets 35%. For each additional assessment, the sum of the previous score calculations decay by an additional 35%.
For example, a student has scores of 1, 2, 3, 4 (scores listed chronologically from oldest to most recent):
(1 × .35) + (2 × .65) = X
(X × .35) + (3 × .65) = Y
(Y × .35) + (4 × .65) = Z (this being the current standard score; 3.48)
n Number of Times
The n Number of Times calculation requires a specific number of times that mastery must be met or exceeded, and the number of aligned items that must be completed for calculation eligibility. Any scores that do not meet mastery are not part of the calculation.
Users can specify between 1 and 10 items required for mastery.
For example, a student is required to achieve mastery 2 times with a mastery score of 5. If the student has scores of 1, 3, 2, 4, 5, 3, and 6, only the scores of 5 and 6 would be part of the calculation.
- Average score of eligible items: 5 + 6 = 11
- Calculated score: 11 / 2 = 5.5
Most Recent Score
The Most Recent Score calculation always selects the most recent score for all assessment items.
Highest Score
The Highest Score calculation always selects the highest score for all assessment items.
Select Average
To select the average score from all assessment items, select the Average option [1].
You can view an example of the Average calculation in the Example section [2].
Note: Average is not a good fit for most outcomes-based or mastery-based learning use cases because students may need time to reach mastery of an outcome and early poorer performance can bring down an average.
Outcome Mastery Scales
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery scales for the entire account.
Learn more about mastery scales in an account or in a course.
Outcome Mastery Calculations
If the Account and Course Level Outcome Mastery Scales feature option is enabled for your account, you can set mastery calculations for the entire account.
Learn more about mastery calculations in an account or in a course.
Improved Outcomes Management
If the Account and Course Level Outcome Mastery Scales feature option and the Improved Outcomes Management feature option are enabled for your account, the Outcomes page displays an improved interface for viewing and managing outcomes.
Learn more about the Improved Outcomes Management in an account or in a course.
ctitmus
in
Outcomes are used to track mastery in a course. From the outcomes page, you can create and manage outcomes, create outcome groups, import outcomes, and manage rubrics.
This lesson displays how to use the Outcomes page in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes
On the outcomes page, you can create a new outcome [1], create a new outcome group [2], and find an outcome [3]. If you have permission, you can import an outcome [4].
To view details about an outcome group, click the name of the outcome group [5].
To view an outcome, click the name of the outcome [6].
View Outcome
To view an outcome, click the name of the outcome [1].
You can view the outcome description [2], criterion rating [3], points needed for mastery [4], calculation method [5], and calculation method explanation [6].
To view items aligned with the outcome and outcome artifacts, click the outcome title [7].
Note: If mastery scales and calculation methods do not display for your outcome, your institution has enabled course-wide mastery scales and calculation methods.
Manage Outcome and Outcome Group
You can move [1], edit [2], or delete [3] an outcome or outcome group.
Note: You cannot delete an outcome that has been used to assess students.
View Student View
To view the outcomes index page as a student, click the View as Student button.
Note: If the course navigation link for the page is disabled and hidden from students, the View as Student button does not display.
ctitmus
in
You can bulk import outcomes for your course using a CSV file. A bulk import allows you to add new outcomes to your course or update the details of multiple outcomes at one time.
The CSV file must be formatted correctly according to the Outcomes Import Format Documentation. Download a sample outcomes.csv file with one outcome group and six outcomes.
After your CSV file has been processed, you will receive an email notification confirming a successful import or displaying errors with your file. If there were errors, the email will contain details about the first 100 errors including the row of the error and a short description.
This lesson displays how to import outcomes in the classic Outcomes page view. If the Outcomes page in your course displays differently than the images in this lesson, learn how to import outcomes in a course within an account that has enabled the Improved Outcomes Management feature option.
Notes:
- Currently, only CSV files are supported. JSON files will be supported in a future release.
- Importing outcomes is a course permission. If you do not have permission to import outcomes, your institution has restricted this feature.
- In new outcomes, the vendor_guid field must not contain a colon.
Open Outcomes
In Course Navigation, click the Outcomes link.
Import Outcomes
Click the Import button.
Upload File
Drag and drop your CSV file to the upload area, or click in the upload area to choose a file from your computer.
Open File
Locate the CSV file [1] and then click the Open button [2].
View Import Status
Canvas displays a loading page while the file uploads. Large CSV files may take time to import. You can leave the Outcomes page at any time without disrupting the import process.
View Import Success
When the file has been successfully imported, Canvas displays a confirmation message. You will also receive an email that the import was successful.
View Import Errors and Warnings
If the import was not successful, or if the import altered existing outcomes, Canvas displays an error message.
The error message displays for outcome import errors and for outcome import warnings.
You will receive an email with details about the first 100 errors and warnings. Each error or warning will include the CSV row number and a description of the error or warning.
Import errors stop the import process entirely and need to be fixed before outcomes can be imported successfully. The following types of errors may occur in CSV files:
- Required headings are missing
- Other headings are placed after the ratings header
- Invalid headers are present
- Required fields are missing
- Import file contains no data
- Invalid UTF-8 string
When an import warning occurs, Canvas skips the affected row and the import moves on. The following types of warnings may occur in CSV files:
- Rating tiers have missing points
- Rating tiers have invalid point values
- Rating tiers have points in wrong order
- Object type is incorrect
- Parent group refers to missing outcomes
- Parent groups are invalid
- Workflow state is invalid
- Calculation validation method not specified
- Group receives invalid fields
- Outcome edits are not within the same context
Correct the errors in the CSV file according to the Outcomes Import Format Documentation and re-import the file.
View Outcomes
View the outcomes imported into your course.
Naomi
in
You can view course content items aligned with a specific outcome.
Open Outcomes
In Course Navigation, click the Outcomes link.
Open Alignments
Click the Alignments tab.
Open Outcome
In the All Outcomes drop-down menu [1], you can view all outcomes [2], outcomes with alignments [3] or outcomes without alignments [4].
Click the expand arrow next to the outcome you want to view [5].
View Alignments
View the course content items aligned to the outcome and the module in which they are located, if applicable.
Aligned items are identified with an icon displaying the item type: assignment [1] or rubric [2].
You can view the number of course content items aligned to an outcome [3].
HeatherAhern
in
This case was unable to be reproduced. If behavior persists, please submit a new support case.
Description
When adding outcomes to a question in an existing New Quiz, the checkboxes for the outcomes are not clickable.
Expected Behavior
Assigning outcomes works correctly.
Workaround
-
Minimizing Options will allow users to progress correctly
-
Editing other questions before assigning outcomes will bypass the issue
-
Adding outcomes when the question is first created will bypass the issue
Steps to Reproduce
-
Create Course
-
Create Outcomes
-
Create New Quiz with any question type
-
Edit quiz and question to add Outcome to question
-
Note that when you click the checkbox it is unresponsive
Additional Info
QUIZ-15302
Known issues indicate notable behaviors that have been escalated to the Canvas engineering team. Known issues are not a guarantee for an immediate resolution. This document is for informational purposes only and does not replace the Support process. If you are encountering the behavior outlined in this document, please ensure you have submitted a Support case (per your institution's escalation process) so Canvas Support can adequately gauge the overall customer impact and prioritize appropriately.
ctitmus
in
You can view outcome reports for all students in your course. For each student, you can view the overview of all outcomes and artifacts, the number of student attempts, latest score, and average percentage.
Open People
In Course Navigation, click the People link.
Locate User
In the search field [1], search for the name of the user. You can also filter users by role in the Roles drop-down menu [2].
Open User Details
Click the user's Options icon [1], then select the User Details link [2].
Open Outcomes Report
Locate the user details sidebar. Depending on the page display, click the Outcomes Report link or button.
View Report
View the report.
ctitmus
in
Outcomes are used to track mastery in a course. From the Outcomes page, you can create and manage outcomes, create and manage outcome groups, and import outcomes.
This lesson displays how to use the Outcomes page in a course within an account that has enabled the Improved Outcomes Management feature option. If the Outcomes page in your course displays differently than the images in this lesson, learn how to use the course outcomes page in the classic Outcomes page view.
Open Outcomes
In Course Navigation, click the Outcomes link.
View Outcomes Page
The Outcomes page opens to the Manage tab [1]. From the Manage tab, you can view and manage outcomes and outcome groups.
To view and manage outcome mastery scales in a course, click the Mastery tab [2].
To view and manage outcome mastery calculations in a course, click the Calculation tab [3].
To view aligned items in a course, click the Alignments tab [4].
To import outcomes into your course, click the Import button [5].
To create a new outcome, click the Create button [6].
To find an outcome to add to your course, click the Find button [7].
View Outcome Groups
From the Outcome Groups window, you can view all the outcome groups in your course [1].
To view an outcome group, click the name of the group [2]. Any outcome groups nested within that group display below the primary group [3]. Outcome group details, including all outcomes that belong to the group, display in the Outcomes window [4].
To create a new outcome group, click a Create New Group link [5]. Outcome groups can be created at the course level or within another outcome group.
You can adjust the size of the Outcome Groups and Outcomes windows by clicking and dragging the divider bar [6].
View Outcome Group Settings
To view the Settings menu for an outcome group, click the Settings icon [1].
To edit an outcome group, click the Edit link [2].
To remove an outcome from your course, click the Remove link [3].
To move an outcome group, click the Move link [4].
To add outcomes, click the Add Outcomes link [5].
To import outcomes, click the Import Outcomes link [6].
To view the description for an outcome group, click the View Description link [7].
View Outcomes
When you select an outcome group, all outcomes in that group display in the Outcomes window [1]. The window displays the number of outcomes in the group [2].
To search for an outcome, enter the outcome name in the Search field [3].
Each outcome displays its name [4] and description [5]. To view more description text, click the Expand icon [6].
To remove or move multiple outcomes, click the checkboxes for the outcomes [7]. The Outcomes window displays the number of outcomes selected in the Outcomes Selected link [8]. To view the names of the outcomes selected, click the Outcomes Selected link.
To remove multiple outcomes from the course, click the Remove button [9]. To move multiple outcomes, click the Move button [10].
View Outcome Settings
To view the Settings menu for an outcome, click the Settings icon [1].
To edit the outcome, click the Edit link [2].
To view the assignments aligned to the outcome, click the Alignments link [3].
To move the outcome, click the Move link [4].
To remove the outcome from the course, click the Remove link [5].
View Student View
To view the Outcomes page as a student, click the Student View button.
Note: If the course navigation link for the page is disabled and hidden from students, the Student View button does not display.
