Reporting Online Course Evals

[travis_thurston]

Our Instructional Designers are evaluating courses in an online program using an in-house rubric as our evaluation instrument. We are now going to report the results to the dept head. How would you concisely organize a report to compare courses, and visually identify quality course designs? We could just send pdf of our rubric evals, but I feel like that is too much for the dept head to try to pour-over. Have you created reports like this in the past, or if you haven't done it before, how would tackle this task?

Any feedback or suggestions would be great

[kona]

We don't do this, that would be a huge deal-breaking no-no with our faculty union, but something I've seen on instructor insight​ is a chart comparing each individual faculty member to the overall average/mode/median (whatever statistic is relevant for your data/question). What I like about this is that it provides context to the information. Ex: Great, this instructor got a 8/10 - yet, if overall most faculty are getting 8/10's then that's nothing to write home to mom about. Same thing for low scores. What if the instructor got a 3/10, but overall faculty got similarly low scores? So maybe not an issue with a specific instructor, but with a policy, procedure, or bigger departmental issue. I also like it when things are given a historical context. Ex: Uh oh, this instructor is only getting a 7/10! Yet, if provided with the historical context maybe this is a big improvement from their last eval, which was a 5/10!

Hope this helps!

[travis_thurston]

This is really helpful,  @kona ​. Thanks for your input

[Stef_retired]

 @travis_thurston , I've changed the format of this post from a question to a discussion to enhance its visibility within the group and invite ongoing participation.