How to unpublish a quiz that had a student submission

Community Member

teacher set up courses; did not realize all the quizzes were showing up as published. A student went ahead and started multiple quizzes even though we just started school and no material has yet been covered.  The teacher tried to unpublish all the quizzes but can't unpublish the quizzes the student went in as it as it has a submission and can not be unpublished.  We do not want other students to do the same thing with these quizzes that can't be unpublished.  Is there a way to unpublish a quiz once there is a submission. Only 1 student has gone in and done this.