Build On Last Attempt: Scoring Options

[MatthewYoung2]

A student tried to make a 2nd attempt on a Quiz and was stuck on a spinning symbol "loading" page. It resolved and the student could retake the quiz after toggling "Build on Last Attempt" OFF. The grading was set to Keep "Average". I considered switching this to Keep "Highest" to see if it would resolve, because that's the setting I've seen others use for BOLA. However, I didn't want to affect other students' scores and bring about any confusion.

Is there a certain Keep Average/Highest/Latest that allows or disallows the quiz to open using the BOLA feature?

[LizGilbert]

I have a confounding variable: I was using BOLA and average, with pulling 4 questions from a bank of 14 questions. The average and bank function worked with re-attempts, until I added in BOLA - that broke it.

I re-created the assignment with BOLA from the beginning, and re-attempts were not possible - see screenshots below. In the "moderate tab" I can see a 2nd attempt is created, but 0 time was spent on it, because it didn't actually load.

My internal IT suspects the problem may be related to question banks pulling random questions so the attempts don't have the same questions to build on, so it breaks the system. 

[MatthewYoung2]

That makes sense to me if the 2nd attempt attempts to continue to pull random Q's as it did with the 1st attempt. My questions for that would be: 1) Is the second attempt going to use the same 4 questions and have the student redo the incorrect questions from those? 2) If not, would the second attempt simply count the number of incorrect and pull the same amount of unused OR incorrect items from the bank?

I'm wondering if it has anything to do with using "Score: Average Attempts" because it contradicts BOLA's function. I suppose it could be programmed the same scoring method as the practice of "test corrections" that I've seen done before with paper/pencil: "you can get half the points back for every incorrect item that you get correct in your 2nd attempt." 

However, if BOLA considers the second attempt to be the same as the first (because you are literally building on the last attempt, not submitting a new attempt) then EITHER: 1) There is only one attempt with two scores, and that is contradicting, or 2) there is no way for there to be a second attempt because the student is only building on their previous attempt, which is also a contradiction.

Or maybe there is some other bug that just doesn't allow Average Scores for BOLA, just Highest Score. 

[afurr0026]

A similar situation occurred in one of our courses on 9/25/2023 as well. NQ using "Enable build on last attempt" with highest score kept out of three attempts. No questions were being pulled from item banks.

Four students were unable to complete a second attempt (did not score a 100 on the first attempt; received error "Something went wrong. Please try again." on second attempt); all were using Chrome 117 and Windows 10. 

However, three students were able to successfully access/submit a second attempt; these students were either using Chrome 116, Chrome 117 or Edge 117 as their browser and Windows 10. 

I reached out to Canvas Support who suggested they clear their browser cache and attempt again. From what I can see on the Moderate page, none of these students have since tried an additional attempt. Support also stated that they will leave a note to colleagues to submit the ticket to the next level of support and the ticket is set as pending for now.

I would suggest that you both report this issue to Canvas Support so that there is documentation regarding the build on last attempt feature. Or ask your institution's Canvas Admin to report the issue to Canvas Support.