As we approach the anniversary of the Classic Quiz Sunset Timeline post
with the extension to June 30, 2024, we can reflect on a year of increased focus on New Quizzes to help us reach the milestones to move us forward. We’ve added more resources to the effort by increasing engineering and product staff dedicated to the work. We continue to meet with customers who help us shape features with their testing and feedback. The hard work, collaboration, and leadership show that Instructure is committed to getting us to the finish line and is willing to provide the necessary support to ensure we are successful.
Find all updates and the most current roadmap on the New Quizzes Hub.
Before we go into the latest New Quizzes achievements and plans for the following quarter, I wanted to make sure that everyone is able to follow along with our current priorities, what we’re looking to accomplish in the near term, and the important resources available as customers and users transition to New Quizzes. Roadmap for prioritized features By now you might be familiar with the roadmap that appears on the Transparency into Quizzes Planning blog post where you can see, in real-time, what the Product team is currently working on and what they plan to do next with New Quizzes. The items on this list represent features that have been prioritized according to the current timeline towards the sunset date in 2024. New Quizzes Feature Comparison The New Quizzes Feature Comparison document shows the current functionality available in New Quizzes as compared to the functionality in Classic Quizzes. We are proud to report that we have released nearly 75% of the items listed in this document. There is only one function that we have noted will not copy exactly in New Quizzes and that’s creating a survey, which we plan to use current/planned functionality to meet those needs. There may be items on the Feature Comparison document that don’t appear on the roadmap but that we intend to address once the big priorities are accomplished. Feature Flag blog post We have recently updated the Feature Flag blog post with more information and release update information. As more of these self-enablement tools are available, we will update with more information. As a reminder, these features are account-level feature options and cannot be managed in sub-accounts. Quizzes Transition Hub The Quizzes Transition Hub is where customers can find updates regarding the Classic-to-New Quizzes migration project and engage in discussions on forums around new features. All blog posts related to New Quizzes can be found at this hub, directly here. All forum discussions can also be found at the hub, directly here, and divided up by feature or topic. Engineering Resources Canvas is focusing our resources towards this important work to get us to each milestone and towards our end goals. In Q2, we moved three seasoned Canvas engineers to our main Quizzes team and it has helped us tremendously in being able to work towards the completion of big ticket items as well as meet the monthly needs of maintenance and support tickets. As well, we have a team working on New Quizzes integrations and specifically focused on the RCE integration work. Each of these resources exhibit the prioritization and hard work of many people who are centered on delivering the most important items over the next two years to ensure that we can support our customers' transition to New Quizzes.
For Q2, we projected four items:
Our intention with the RCE Integration work is to have full Canvas RCE in New Quizzes. For an update from the team dedicated to the RCE, please see this blog post which describes their journey so far and how the work is broken up so that we can deliver the most important features that are needed for the Bulk Migration Tool to reach the needed functionality.
Migration Tool UX improvements
In the past two quarters, the Bulk Migration Tool has been in beta and we appreciate the many customers who have tested and provided feedback on the tool. While we are still awaiting the RCE integration into New Quizzes before releasing the tool into production environments, we have been addressing issues that have come back from testers and feedback in the community on the functionality of the migration tool.
Here is a list of the related fixes or features that we have completed in the past two quarters since the bulk migration tool was released in beta environments:
Improved Grading Experience
As described in this post, New Quizzes that require manual grading now appear in an instructor’s To Do List. In the gradebook, instead of a partial grade, a New Quizzes icon will be displayed that shows the quiz is pending completion of grading.
When students complete a quiz that requires manual grading, they will not receive notification of a graded exam until grading has been completed. Partial grades will not show up in their gradebook, to avoid the early notification or visibility of incomplete grades. New Quizzes will not appear in the student’s recent feedback list until after the teacher completes the manual grading.
As soon as a teacher clicks to “Updates Scores” in Speedgrader, then Canvas will see the quiz as completely graded and remove it from the teacher’s To do list and will be displayed in the student’s recent feedback.
This Course Filter
Along with the other Item Bank Management Clarification work completed in Q1 to clarify and improve how to search for item banks, we added a filter called This Course. The purpose of this filter is to display any Item Banks used in the course which the logged in user has permission to see (share settings of view or edit). After release, we found an issue with the filter on courses with large numbers of assignments so we had to pull it back to add operational improvements to support very large courses. The current quizzes infrastructure and performance improvement work will address this issue and improve the overall experience.
Rich Content Editor in Fill-in-the-Blank questions
Following the addition of the Rich Content Editor in Fill-in-the-Blank questions in Q1, we received feedback from users who needed to use specific types of characters either for different languages or for scientific questions, so we improved on the work by allowing for any character within the backticks which include any special character (parentheses, math operators, etc.) and accents.
A screencast on Rich Content Editor in Fill-in-the-Blank questions can be found here.
Issues from related Release Q&A that have been completed:
Item Bank Icon Update
Based on feedback from our community, we have changed the icon for item banks and resources within Canvas LMS and Mastery Connect from a piggy bank to a file folder. We have recently received feedback from our users from various cultural groups that the pig has negative connotations, and we want all learners to feel comfortable using Instructure products. As a global company, we want to recognize the nuanced cultural differences and avoid using imagery that is offensive. We are committed to diversity, inclusion, and belonging and to serving all members of the Instructure family.
Link to Press release
Our objectives for Q3 are to focus chiefly on the RCE Integration work and the other two big priorities of Blueprint courses along with continuing our Infrastructure and Performance Improvements in order to ensure a more stable environment as more users transition to New Quizzes.
An update from our team working on New Quizzes Integrations can be found here, where they provide information on Rich Content Editor, API, and Item Analysis.
Blueprint Course in NQ
Our Blueprint priorities in Q3 include completing the Blueprint Courses improvements so that courses can sync after the initial sync and item bank changes related to the course will also sync, then moving on to begin the work allowing locking on Blueprint courses in New Quizzes.
Infrastructure and Performance Improvements
We are making several upgrades to our core infrastructure to provide continued service and performance improvements.
FITB in Word Banks with multiple answers
This work improves the experience for FITB questions with multiple blanks since previously each blank was treated as having its own isolated set of choices rather than a true word bank with a common pool of answers. On completion, the question type will support a common word bank where the answers disappear as they are used or they may be used in more than one blank.
New Quizzes Outcomes in Learning Mastery Gradebook
Our Outcomes team is working on making results for New Quizzes with item and quiz level outcome alignments available in the Learning Mastery Gradebook and in admin-level outcomes .csv report exports that provide data on student mastery over all aligned assessments. Previously these results were only available for individual quizzes in the Outcomes Analysis report.
Hello! @MPioRoda - when able, please share additional information for how the bulk migration tool handles question groups. I see from the list above that the migrated question groups share with the new course but how does this work?
Could the documentation be expanded? For example, this FAQ document does not address how to transition question groups to NQ.
This KB article does not provide sufficient details on question groups. Question groups were used with CQ to create a group of questions from which a random set of questions could be pulled. How is this to be replicated with NQ?
Could a workflow for converting a CQ that is made up of several dozen question groups be demonstrated? What are the necessary steps and best practices here? This should help us avoid any missteps as we work to help faculty transition quizzes that use more than two hundred question groups.
@Jeff_F I believe that CQ question groups convert to individual item banks ("Question groups with manually created questions will migrate as item banks in New Quizzes").
Can that be confirmed, and if that's the case, what is the management plan? I've asked this before, but if a CQ has 25 questions, each with their own question group, and there are, say, 5 exams, that means in NQ it will generate 125 item banks associated with that course alone (not counting any unit quizzes).
If this is the case, that question groups transform into individual item banks, as an admin, I could potentially have access to thousands or millions of item banks over an entire subaccount.
This does not seem manageable. Won't that slow things down considerable if I try to access all the item banks I have access to? Won't it, like, break something?
Can Canvas confirm or correct my understanding?
Phase one is our number one priority, the release dates will be confirmed as we get closer to work being completed and reiterate that we are doing this in a phased approach in order to provide benefit at earlier stages of the development instead of making it available at the end of full development.
I submitted the following request for clarification to the Transparency into Quizzes Planning page but since that page makes it clear that a reply is not to be expected, I'm cross-posting it here:
I had thought a downloadable CSV file for the "Quiz and Item Analysis" report was listed on the Transparency page, but now I can't find it. Can you clarify if that is still on the roadmap and if so which group (Planned Next, Possible Later, Before July 2023, Before June 2024) it would belong in.
There is also, as far as I can tell, no Instructure response on the Feature Request:
I would appreciate any information pertaining to this to be able to set expectations accurately.
Thank you! I'm very glad to hear that. It would make it clearer (to me, at least) if the Transparency log used "Item Analysis CSV" or "Quiz and Item Analysis CSV" (using the title as it appears in the New Quizzes reports section), to differentiate it from "Student Analysis" report which is listed in the same column. Thanks again for the clarification.
Thanks for this great update, @MPioRoda! Very helpful.
I would like to see QTI export available in new quizzes, for both item banks and quizzes. Any idea when that might happen?
Current methods of sharing item banks doesn't work well for us because it allows either editing of the original or view only. Sometimes you want the teacher to have a copy of the bank so they can make their own edits, and not make changes to your original. A QTI export would fix that by allowing others to import a true copy to their own courses.
QTI export would also allow instructors to move quizzes from one institution to another.
Can we please have rich text editing in ALL question types and answers? As a math teacher, this is frustrating that I cannot use math text in matching questions. I want to have them match the square root to their answer, or the picture to their answer even, I have more features to request, but you like them in separate posts. The biggest is this though. Other platforms allow me to have math text in all question types, in the matching portion included (like Schoology). It is something that can be done, so please do this for all of us math teachers out there who are frustrated that we cannot create questions akin to state testing.
Another suggestion, can we please have more than one hot spot? Like I want them to place two points on a number line, not just one. Again, It's frustrating because I cannot make it look like their state tests.
Another suggestion so we again, can make it look more like state tests, is to have drag and drop. If they could take a bank of things and drag them to a certain place, that would be very helpful. Again, other platforms have this option, so Canvas could do this.
Feels like New Quizzes are still years away from catching up to the essential core features Classic Quizzes had years ago, and still dealing with entanglements and repercussions of the LTI approach that was originally meant to make this a faster and more scalable deployment. Our organisation has had to re-build multiple courses worth of assessment content in Classic Quizzes as issues we had thought had been fixed, such as blueprint syncing, permission/role confusion and feedback display errors, wound up causing problems yet again. Horribly frustrating and disappointing that a development on a perfectly functional and stable feature was and still is discontinued in favour of a system that is not fit for purpose and is still years away from being fit for purpose.
To see my questions you can scroll up or click here:
Links and content in this post have been edited to reflect the announcement that occurred on October 26, 2022. Please read We’re Listening: New Quizzes Features, Classic Quizzes Timeline for the most up-to-date information regarding New Quizzes.