Exactly! @Dfez00, if you plan on making this a commercial, or even an open-sourced or free app for others to use, I would highly recommend you to follow the industry standard LTI approach.
I can tell you as a Canvas admin myself that an app using an admin user API token would basically never get approved for use at this point in most public higher-ed institutions in the US. If you're using a developer key, that is slightly better, but would still face a lot of scrutiny and in my opinion would get rejected by most institutions.
Without more info, it's hard to give a ton of advice. I guess it would be really good for us to know if you're developing this app for one specific school or do plan on having it available to a wider audience than that. If the former and the school approves of your approach, maybe you can ignore our advice. if it's the latter, I think it would be a good idea to pause and potentially rethink the approach.
I know you mentioned LTI wasn't flexible enough for what you were trying to do. Could you give any examples of what LTI won't let you do that you'd like to? Hopefully you could give a few examples without revealing any trade secrets about your app idea.
In the end, you can decide how you want to make your app. Folks in the community here have a lot of experience in different LMS-related roles though so there might be some things here you have't considered yet. Even if you accept security risks yourself, it's generally the school/university using the app that makes the security assessments on their own, and those assessments have been getting more and more strict through the years.
-Chris