Looking to discuss this feature from the 2021-09-18 Release Notes? Post a reply and start a conversation!
Note: As of 2021-09-17, this feature has been delayed from being released in the production environment. An update will be posted when available.
- This topic is for feature discussion only—please share use cases, best practices, etc. regarding this feature
- Please thread replies as much as possible to keep posts organized
WHERE SHOULD I POST...?
- Idea enhancement feedback to product managers should be submitted in ideas.canvaslms.com (though linking to the idea here so others can find it is welcome)
- Bug reports should be submitted to Canvas Support—bugs will not be triaged in this thread
In Canvas Feature Preview: Improved Outcomes Manageme... - Instructure Community, the API section says "In lieu of the REST API, this feature uses GraphQL mutations. Queries include learningOutcomeGroup, outcomeCalculationMethod, and outcomeProficiency."
I'm not clear what "this feature" refers to. I currently run several automated processes that manipulate outcomes and outcome groups via the Outcomes API and Outcome Groups API. Are these REST API endpoints on the way to being deprecated?
No deprecation notices have been issued. We are calling out that the Improved Outcomes Management feature uses GraphQL instead of REST API. We have several features that are using one or the other.
However, our product blog recently included a post from our engineering team, who has indicated that Canvas will move to using GraphQL in the future. See From the Engineering Deck: Instructure & GraphQL - Instructure Community
I'm finally getting around to exploring this and I noticed that when we turned it on in beta, rubric scores were removed from the Outcome. I know that Rubrics and Outcomes are disentangling a little bit, but a major part of using Outcomes was the ability to give granular feedback via rubrics on a skill or idea attached to an assignment.
I've spent a lot of today playing with it and I can't figure out how to add a scorable Outcome back to an Assignment once the improved management tool is enabled. Am I missing something basic?
Now that mastery calculation has been broken out into its own tab, do we still have the ability to set different calculation methods for different outcomes? For example, using the old interface I was able to set my grammar standards to n number of times as the method of calculation. I then had standards like identifying theme set to decaying average as the way to calculate mastery. In the new interface it appears I can only select one calculation method for all outcomes.
I have the same questions/issues as bbennett2 and Sopko.
Additional Question: For the Mastery tab, will we be able to set the mastery level? Also, will we be able to change the names of each level?
We have outcomes imported in different flavors as we could with the import CSV at various subaccounts and our top level subaccount. These outcomes have been aligned to assignments across our institution and our currently being assessed in an academic year for which we want an academic year data. What will this change mean to "already in progress" assessment of outcomes? Will the new changes also require re-entry of the program outcomes that already exist?
I'm Ben Friedman, Product Manager for the Canvas LMS Outcomes Team. I will be keeping track of this thread and answering questions as they come up. Thanks to those of you who have posted comments and questions!
@bbennett2 , @Sopko , and @nathanleesSSD Currently, the Improved Outcome Management feature is paired with the Account and Course Level Outcome Mastery Scales feature, and both “Feature Previews” will need to be enabled. Once the Account and Course Level Outcome Mastery Scales feature preview is enabled for your account, sub-account, or course, mastery scales and calculation methods are separated from individual outcomes and become consistent across that context. The Outcomes page then displays Mastery Scales and Calculation Methods as tabs (see screenshot below). Please note that we’re going to be doing some additional work to bring the capability of setting these at an individual Outcome level back over the next few months within Improved Outcome Management. Stay tuned if that is important to you!
@bbennett2 In terms of adding an Outcome to an Assignment rubric, that can still happen with the new feature enabled. I love that you are giving granular feedback to students through rubrics - that is really taking advantage of the capabilities Canvas offers!
@nathanleesSSD You can indeed customize Mastery Scales in the tab by setting the exact number of levels you would like, changing the names or “descriptions” and “points” for each, and even adjusting the color paired with each level. See more information here.
@nelsonreg You can find the full impact of making a change here. Enabling the Account and Course Level Outcome Mastery Scales feature preview will affect current account data. If a rubric with aligned outcomes has been used to assess an assignment before Account and Course Level Outcome Mastery Scales are enabled, however, the assignment is not affected. Any assignments that have not been assessed by the rubric are affected if mastery scores are adjusted. Please connect with your CSM if you’re considering this so you can talk through the details.
Hi, our institution is just starting to test adding Common Learning Outcomes. Should I enable the 'Improved Outcomes Management' now while we are testing because eventually this will replace the older version? I am not sure what the timeline is for this since it is currently a feature preview.
We are piloting a few courses with our new CLOs in Spring of 2022 with the idea of adding them to our instance in Fall of 2022. Any advice @BenFriedman ? And we do need to ask our CSM to turn this on for our test instance, correct?
@olguin You do need to work with your CSM to turn on this feature at this time. Part of the reason is that currently you also need to turn on the Account and Course Level Mastery Scales feature preview - the two are tied together. A few factors to consider:
- First, review whether you already have the Account and Course Level Mastery Scale feature preview enabled. There can be an impact on data (other than already assessed rubrics) if the rating scale changes so we do not generally recommend enabling this feature during a school year.
- We're currently in the planning stages for pulling the two features apart in order to support use cases where defining a mastery scale, calculation method, and description content on an individual Outcome basis is necessary. If any are needs in your context, then it would be good to wait until we finish this next set of work.
Yesterday our CSM team turned on the Improved Outcomes Management within our "Beta" environment so that we could start to do some testing on our own. We already had already started building what we call "Career & Life Skills" into the "Outcomes" area of Canvas...prior to turning on the Improved Outcomes Management feature preview. We have these stored at the Canvas account level. Here are a couple things I've noticed so far...
@chofer Thanks for trying out this feature and posting about your experience. Right now, the "Improved Outcome Management" feature is paired with another feature - "Account and Course Level Mastery Scales" and both need to be enabled with the help of a CSM in order for Improved Outcome Management to work. We are currently engaged in work that will bring back the ability to set a calculation method and criterion rating scale for individual outcomes within Improved Outcome Management.
The changes to the rubrics you are identifying are related to Mastery Scales. The power of this feature is that is it efficiently creates a common mastery scale across Canvas so that they don't need to be set for individual outcomes and will be represented in rubrics and the Learning Mastery Gradebook. While this level of consistency is highly valued by many of our customers, it sounds like it may not be the best fit for your use case, where it sounds like more control over rubric rating scales and indicator descriptions are necessary. In this case, we'd recommend not using Improved Outcome Management until our work on calculation methods and criterion ratings for individual outcomes is complete.
I'd like to be able to add descriptions to the ratings criteria for Outcomes because we have many faculty that assess student work that rely on a printed Outcomes rubric. Is this possible or in development?
@kshaffer2 The teachers I work with have the same need. They want to be able to set up Outcomes with ratings descriptions, beyond a label, like "Exceeds Expectations". They would like the same editing capability that you experience when creating rubrics with non-Outcomes criteria. Uploading an Outcomes .csv may accomplish this, but is time-consuming and somewhat confusing.
I believe we had this flexibility before the Outcomes change in September.
So glad to hear that the ability to set mastery scales and calculation methods at the individual Outcomes level will be restored. This is important to our institution as we have scenarios where setting these differently for individual Outcomes is very important in our school's Program Assessment.
@kshaffer2 & @paul_witzel Currently, if you have Improved Outcome Management and the Account and Course Level Mastery Scale flags enabled, you are not able to edit criteria/descriptions in rubrics for individual outcomes since the mastery scales are consistent for all. As I mentioned above, we are currently in development to bring back this capability. It will then work as in the past - detailed descriptions can be added to individual outcomes and then brought into rubrics through alignments.