Hi @NoahBoswell ...

You are correct that there isn't a way to schedule a page to be unpublished from your course.  You would have to do this manually right now.  If you wanted, you could submit this as a new Idea here in the Community so that it could be potentially evaluated and maybe even implemented in Canvas.  (It has to go through the normal idea/voting process.)  Here's how to do this...starting with reviewing the links under the section "Ideas and Themes":

Instructure Community Guide - Instructure Community (canvaslms.com)

Then go here to click on the blue "View and Submit Ideas" button on this page:

Canvas Ideas and Themes - Instructure Community (canvaslms.com)

On the next page, click on the blue "Submit an Idea" button.

I hope this helps...even though it's not the answer you were looking for.