Hello @nscheel ...
Adding icons to the beginning of content page names isn't something that is a normal part of the Canvas environment. It looks like whoever designed those template pages found a way to add an icon to the page name. Are you able to edit the page at all to see where the icon is to try and edit it? How do I edit a page in a course?
Hope to hear back from you soon! Let us know if you have any questions about this...thanks!
I should say that recently I have used unicode characters in page names to warn students that the page contains examples of what should not be done. For example: