Hi @htseng ,
Thank you for posting on the Instructure Community!
To my knowledge, there is currently no feature that allows you to quickly embed all the videos all at once into a playlist-like form into your modules. The easiest way I'd go about this is by creating a page in your Canvas module, then embedding all the videos onto that one page, that is do-able. You could also do what you mentioned you wanted to avoid doing, which is add them individually to each page.
You could also do external links and add a URL to your module, but then student analytics wouldn't be available if you did it that way. I'd say the first way I mentioned would be the best solution for you.
I hope this helps, always feel free to reach out with any additional questions or concerns you may have.
Best,
Noah