@mjlicht ...
Thank you for providing the clarification. Based on your latest reply, I may have misunderstood your other posting. That makes sense now that you've provided more detail. In looking at the "Permissions" screen in the admin side of Canvas, the "Grades" and "SpeedGrader" areas aren't separated out to only give permissions to one or the other. They are all combined together...so yes, what you were told is currently true. I don't know if there are any plans to further separate these two areas from each other since they are so closely tied together.
If you wanted, you could submit an idea here in the Canvas Community so that others could evaluate it and it could have the potential to be voted on. Here are some instructions on how to get started with that process:
How do I create a new idea in the Instructure Community?
Sorry I don't have better news for you, but I hope this helps in some way.