When the Stakes are High (Part 2): Facilitating Online Assessment

Jess_Jones
Instructure
Instructure
0
1983

In Part 1 we explored best practices, practical tips, and considerations for creating online assessments.  In this Part 2, we’re focusing on the assessment itself and the provisions that can be put in place to ensure that online assessments run smoothly.

Consideration 1: Will Canvas be able to handle this?

In short - yes!  Canvas can automatically scale to address increased needs imposed by COVID-19 and then again heightened by assessment periods, or indeed by any other situation that might require an increased use of the platform.  From more users, to more assessments, to more simultaneous access, Canvas will scale.  And we have.  In March 2020 alone, millions of users used Canvas around the world, we saw an 85% YOY increase in learners accessing the platform simultaneously, and through it all we maintained 99.9% uptime.

347415_we-are-all-in-this-together.jpg

For more information, and solid reassurance on how Canvas will scale, take a look at the following blogs that have been written throughout COVID-19.

 

While Canvas has proved it is up to the task, technology is only as good as its users.  There are important steps we can all take to ensure that students, teachers, and everyone involved in the process are suitably prepared for a successful online assessment context.

Proactive Support 

Empower everyone involved in assessments by clearly communicating both the expectations and support options available to them.  Students need to know where to find their assessments, how to complete them, and what to do if they need support at any point of the assessment period.  Teachers need to know how to create assessments (if they are required to do so), as well as how they can access support with the transition to and management of online assessments.  

 

Once you have decided on the workflows and resources you would like to provide for students and teachers on how they can gain support, communicate this clearly so that everyone is empowered with access to the correct, relevant information.  This could be achieved with a Global Announcement, differentiated by user so that Teachers and Students see the information that is pertinent to them on their Canvas Dashboard.  Additionally, customise the Help Menu to prioritise relevant assessment support available.

 

 347416_Screen Shot 2020-05-09 at 18.01.29.png

 

When considering support resources, make the most of existing resources to both provide and communicate these support options.  Use the existing Canvas Guides to provide students and teachers with ‘how-tos’ for completing assessment activities within Canvas.  These guides include screenshots alongside comprehensive, step-by-step instructions and best of all, we keep them up to date so that you can have complete confidence that they will always provide accurate information.  

 

You may also have additional internal support resources such as student experience, learning support, or ICT department telephone or email addresses.  For Teachers who will be creating their own assessments, training provisions need to be considered so that Teachers are able to make informed decisions about how to use the available tools.

 

Taking proactive support measures empowers students and teachers with the information they need to achieve a successful assessment experience, and can minimise the need for reactive support at the time of assessment itself.

Practice Makes Perfect!

Provide students with the opportunity for a trial run.  If they will be taking a Quiz, create a practice Quiz and include different Question Types that will be used during the real assessment.  Questions could even be related to the process of how to complete the assessment, reinforcing understanding of the workflow. If students will be submitting an Assignment, create a test Assignment and ask students to practice accessing and submitting the Assignment.   Make these practice assessments available ahead of the real assessment, so that students have plenty of opportunity to ensure they know how to complete their assessment when the time comes.

Consideration 2: Providing Time Parameters 

All assessments require students to complete a given task within a certain time frame.  There are various ways to replicate this on Canvas depending on the type of time parameter required.

Deadline for Submission 

If you have a specific date and time that an assessment must be completed by, add this as the Due Date in any Assignment or Quiz.  Canvas will still accept submissions (for Assignments) and allow attempts (for Quizzes) after the due date, though they will be identified as late to both the student and the teacher.  Adding an Until Date can be a helpful way to replicate any existing policies you may have around late submissions (i.e. late submissions will be accepted for up to 1 week after the deadline with a penalty applied during the grading process).  The Until Date prevents Canvas from accepting any submissions or attempts after this date.

 

 347417_Screen Shot 2020-05-09 at 18.05.12.png

Timed Assessment

For assessments that have specified start and end times (such as exams), there are two methods for facilitation in Canvas.  For exams using the Quiz tool, a time limit can be applied to each attempt.  For all Assignments, we can add an Available from date, which when used in combination with a due or until date creates a start and end time parameter around the assessment.  Keep in mind that setting an ‘Available From’ date will prevent students from accessing any information added to the RCE or settings applied to the Assignment.

 

347418_Screen Shot 2020-05-09 at 18.18.37.png

 

There may be information about the assessment that you would like students to have access to ahead of the Availability Dates, such as what resources they might require or how long they will have to complete the assessment.  A great way to do this is using an Announcement.  Not only will this be easily accessible to students from within the Course, but it will also trigger a notification via their chosen notification preferences.  The release of the Announcement can also be coupled with a delayed posting, effectively providing a timed release of this assessment information.

 

347419_Screen Shot 2020-05-09 at 18.21.18.png

Scheduled Release of Assessment(s) and/or Resources

Where there are multiple pieces of assessment content that you would like to be released at a specific time, use the Lock Until feature within Modules to schedule the release.  This will allow students to see only the title for each piece of content before this time, providing them with the reassurance that they know where to find their assessment content as well as the exact time they will be made available to them.

 

347420_Screen Shot 2020-05-09 at 18.23.48.png

 

This feature is useful particularly when there are multiple assessment points opening at the same time.  Do keep in mind that if you have added any Files within the Module or RCE that these could still be accessible from the Files tab if this is available to students within the Course.  Make sure to add availability dates to the files that match your assessment if this is the case.

Consideration 3: Exam Integrity 

As with all assessments, we want each student to make an authentic submission.  Canvas has partnerships with a variety of tools that can provide plagiarism checks and proctoring solutions.  Explore how many of our partners are here to support you through these extraordinary times, or talk to your Customer Success Manager for more information on appropriate solutions.  Meanwhile if you are delivering your assessment with a Quiz, take a look at this detailed resource exploring the variety of inbuilt settings available to maximise security.

 

As with in-person exams, occasionally situations may arise during the assessment where responsive action is required.  The Moderate the Quiz panel allows us to monitor student progress during the quiz, as well as give extra time or attempts to individual students should this be required in response to any given situation (perhaps the student had a connectivity issue for example).  We can even manually submit any outstanding attempts should students forget to do this, allowing the grading process to continue without delay.  Though if a time limit has been applied, Canvas will do this automatically once the set time has passed.

Keep In Mind

“The best laid plans of mice and men often go awry”

 

As educators, we are all too aware that even the most well planned in-person assessment can be impacted by unforeseen circumstances.  Adverse weather can lead to rescheduling, an on campus event can lead to a distracted cohort, or a forgotten resource can impact a students’ ability to access material.  Technology will never entirely remove the risk of unforeseen circumstances, but we can certainly make ourselves aware of the potential risk factors and mitigate them as best we can.

 

  • Will students have a device and sufficient internet access to enable them to access the assessment? Providing trial runs and practice assessments can help to spot these potential issues.

  • What if something happens to a students’ device or internet connection during an assessment? In an in-person environment, a student would raise their hand to inform an invigilator - provide students with a suitable alternative workflow when they are working in a remote setting (refer to the Proactive Support section for ideas on how to communicate this with students)

  • How will IT staff be able to support multiple teachers and assessments remotely if incidents occur? Consider staggering start times and deadlines to allow internal support to be available and responsive at these key crunch times if required.

Just as you might have policies in place for how to respond to unforeseen circumstances in an in-person context, have policies ready for how you will respond with unforeseen circumstances in an online context.  Share these clearly with students, and as always apply them with parity as best as possible.

Summary

One of the best ways we can respond to change is to embrace it.  The current context is forcing us to adapt in many different ways, from how we shop for groceries to how we effectively provide opportunities for assessment.  Understanding the tools available to us can enable us to make informed decisions about how to best facilitate assessment within the new context that we find ourselves.  The method we use may have to change, but hopefully these blogs have given you ideas for how you can continue to achieve the intended end goal.

 

Contingency Planning

Read More Contingency Planning Blogs