I am currently in the process of developing an application to retrieve and import Canvas Data into a local database.
I have a process which runs the CLI application and saves and unpacks the files and a task which reads those files and inserts them to our database, however it seems that we are not capturing all of the data.
Can someone explain how the data is incremented in these files? Is the CLI program capable of downloading all of our data, instead of a daily amount? Is my only option in using the Canvas Data API if I want to retrieve the entire set of data?