we've been testing plagiarism review options, and I am going to reach out to support, but, I feel like maybe I'm just missing something simple maybe one of you know. 

In adding/removing some plagiarism checkers to the plagiarism framework on the admin level to do testing, the old ones, even after their apps are removed from canvas, show up. How do you get rid of these?