Are there other institutions who are actively trying to implement institutional assessment using outcomes or are interested in doing so?
At the University of Wyoming we are working on a plan to assess student learning on a department/college/institution wide level using outcomes and rubrics. This process is part of ongoing accreditation reviews where the reviewers need to see specific learning artifacts which correspond with specific learning outcomes as examples.
One specific question is that we need to download specific learning artifacts associated with an outcome. Say, all the papers submitted to the english department or across the institution which are connected to the outcome for critical thinking. You can already see a list in Canvas of "outcome artifacts" associated with an outcome with links to the student submissions but we need an easy way to download them all…Then we need a mechanism whereby reviewers can access and assess these outcome artifacts (ideally without individual student information).
It seems like the learning mastery grade book, outcomes and rubrics have been designed with this all in mind but there is currently no road map as to how to accomplish this in practice. The canvas guides speak to these capabilities:
"Grading student work automatically collects and compiles data on student progress for the Outcomes. The data is available for reporting to support teaching improvement, identify at-risk students, and support the accreditation process. This unified, streamlined approach dramatically reduces the amount of work required to implement Learning Outcomes through the intelligent reuse of assessment workflows in the grading process."
I have had experience with both, though most of it was for our school of Ed. My former institution swapped away from using Taskstream to all Canvas and as far as I know it went fairly smooth. There of course was a learning curve mostly because Tasksteam would automatically crunch numbers and in Canvas it required something to interpret the .csv
Essentially (and you'll have to forgive my brevity because I was not directly involved with this project), we had 3 people as account admins creating all of the outcomes. One of which was the accreditation coordinator, who interacted with the faculty to help setup rubrics for assignments. They also were able to go into courses to pull examples/samples as needed.
They were able to run the reports as needed, though for a while we would have to run it for them. Then it was a matter of graphically representing the data.
Shaun would any of the "3 people as account admins creating all of the outcomes" be willing to describe the process they used. A white paper or How To, or share templates that were created to report out? Thanks
David - At Tacoma Community College, we have 3 people as account admins create all of the outcomes. We did a presentation on it during the 2015 Instructurecon and you should be able to find the recording. What we do is get exports from Cirricunet, where all of the college's outcomes are centrally tracked. We massage the formatting in the Excel files a bit and then copy/paste them into Canvas. We have all of the college's outcomes setup at the account level. We have 3 main outcome groups, with many sub-groups - Courses, Degree Learning, and Programs. Any instructor can navigate any of those groupings to get the specific outcomes they want.
The one thing we still need more work on is versioning. We are currently just keeping everything updated, but have considered naming outcomes v1, v2, etc or something to signify that it is an old version.
I should let you know that depending on how immediate you need this that I was stopped after the presentation by an employee of Canvas (I have to get his name again from our CSM and will post it when I do so) that assured me that all of the issues I discussed as being problems in collecting the data that I want and the broken parts of Canvas involving test banks was going to be fixed. He is new to Canvas and this was one of the duties he was specifically given. I have a meeting with our CSM Wednesday and I am going to ask to set up a meeting with him to see what kind of timeline they have in mind for fixing this.
Here is what I am asking them to do:
Hi there, phineas!
Given that this question is from over two years ago, and that there have been many updates to Canvas during that time, I am going to mark this as "Assumed Answered". We'd love to hear from you and have your thoughts on some of the resources shared!