That doesn't work as I need to know if they know how to say yes, not if they can identify the word yes. It is a different skill from a language learning point of view. Another example would be to say "How's it going?" the student should respond, "¿Qué tal?. As you can see, a student could respond "Qué tal?" and they have the concept correct but made one small grammar error. As I currently see it. Canvas makes me mark it all or nothing. I can't use a multiple choice questions because then I am giving the answer and the student only has to recognize it, not produce it.
Thanks for the suggestion though.