[ARCHIVED] What course evaluation software do you use?

[MikeBrinkman]

We're currently using an antiquated course evaluation software package, and looking for something a bit more modern. Please let me know what you're using and if you like it. Thanks!

[EvanDonovan]

We started using Ungraded Surveys directly in Canvas. There are some limitations, particularly around statistics, but I think it will be adequate for our needs.

I also have thought about whether embedding a Google Form in an <iframe> within the course would be a good solution, since, in theory, it could save a step by exporting the results directly into a spreadsheet. On the other hand, the Ungraded Survey in Canvas requires us to export to Sheets to do some of the analysis that we need to do each term.

[EvanDonovan]

By the way, I haven't used any of the tools linked in this forum post, but I wanted to cross-reference it in case it is a helpful reference. (Canvas' forum suggested it as potentially relevant.)

[heather_stockfo]

We have been using Evaluation Kit by Watermark and are happy with the product

[dwillmore]

We are using Anthology's Surveys - CoursEval.

[amyslack]

We are currently using this and are leaving it for Watermark - there was an overall usability issue, set up is very labor intensive, and strange limitations, like only 10 sections will import in the data import... which for us we use sections a lot for our clinical rotations. Hoping Watermark will be better 🙂 

Update 1 Year Later: 

We implemented Watermark Course Evaluations and Surveys (CES) and it was absolutely amazing. Our response rates went through the roof - seriously we were in the teens and twenty percentage if we were lucky in Anthology and in Watermark we were asking questions if it was anything under 80% - so truly an amazing turn around for our response rates. Also the time to set up was DRAMATICALLY decreased. The ability to copy projects - actually preschedule them - the integration between Canvas and Watermark being so much easier to manage - and just overall user friendly-ness of Watermark truly has an amazing impact. I truly recommend Watermark's CES tool - it really will change how you handle evaluations and surveys!

[ThomasDrieam]

Hi @MikeBrinkman,

Ive also seen many institutions use Qualtrics for course evaluation purposes, mainly due to their extensive question provisioning and data analysis tools. 

Thomas

[Jennifer_Mayes]

We also use Course Evaluations and Surveys (formerly EvaluationKit) by Watermark. I am an admin for both Canvas and EvaluationKit and the two work together quite well.

[kfalcone]

Jennifer-  Are you aware of any user groups to connect with other admins to share best practices for using Watermark Course Evaluations and Surveys with Canvas?  I am our new Admin for Watermark and am realizing that although we have had the system for a long time, I think we have some opportunities for using it more effectively and efficiently.  For example, we have never turned on the faculty dashboard and I would really like to make it available.  And we seem to have some oddities in our Canvas integration that are preventing the ability to do things like set eval availability by course date.  I would love the opportunity to connect with others and it doesn't look like Watermark has provided the ability for a learning community of users like Canvas has.

[chriscas]

We've used Watermark CES (EvaluationKit) since around 2014 and it's really worked well for us.  I think some of the things you're asking about will really depend on exactly how your integrations and any external data feeds are set up, along with your organizational structure (which will impact setting up hierarchy and admins).  I could talk about our setup, which relies solely on Canvas (no feed from our SIS), but it may not really apply if your structure and needs are completely different.  I agree that having an area to talk about this would be nice, because it does seem like there is a general lack of knowledge in this area.

-Chris

[heather_stockfo]

@kfalcone,

My Watermark CSM offers regular regional webinars with other peers within my region. You might try reaching out to get involved in those.

If you're not sure who your CSM is, you might try reaching out to mine. She calls them "Circle of Success": 

vramirez@watermarkinsights.com

Best,

: )   Hea

[Jennifer_Mayes]

Gosh, I'm so sorry! I never got a notification that I had a response to this. I actually am not aware of any user groups. Most of what we have learned about our instances is definitely through contacting support and figuring things out on our own. 

[Pete5484]

I’ve previously used Qualtrics and Evaluation Kit. Both very capable. But qualtrics was “fiddly” when I last used it for course surveys; though it would be my go to large survey tool. However, I’m actually getting a demo of Blue by Explorance tomorrow. It, too, looks interesting and is popular in .au. 

[DerekStevens]

Would you be willing to share your issues? We are looking at this tool for our institution on Monday. Curious what I should test against to see if we see similar issues.

[Pete5484]

There wasn't LMS integration at that time (we were with another LMS provider) - and at that time qualtrics lacked functionality around rolling up data. But it did generate good response rates. I would have liked the ability to automatically generate margins of error and confidence intervals automatically. At that time Qualtrics didn't do textual analysis. I imagine that has changed. I wouldn't hesitate to use it as an academic research tool.

The Blue demonstration today looked amazing! Sentiment analysis, machine learning, and the ability to slice and interogate data in multiple ways!