Is there a way to take a quiz as a test student without publishing the quiz?

I would like to test the quiz prior to assigning it to students, or making it visible for them. But, once I take the quiz as a test student, I am not able to unpublish it. 

Thoughts?