CD2: increasing failure rate for canvas_logs

[mclark19]

Has anyone noticed increasing failure rates with canvas_logs recently? I know there was an outage on Saturday, but we've been having intermittent issues since then and are wondering if we are the only ones. Our other tables have been fine. I don't see any issues on the status page.

[Edina_Tipter]

@mclark19 Please see my blog post: https://community.canvaslms.com/t5/Data-and-Analytics-Group/Canvas-weblogs-operation-issues-North-Vi...

The status page has also been updated.

[JamesSorenson]

I have yet to successfully download data from the web_logs table.  I've had an open ticket in for almost 2 months with very little communication.

[reynlds]

The whole thing is flaky as can be and certainly not "production ready" IMHO. I've had to resort to dropping and initializing tables daily in order to have something I can use as the errors are many and the DAP client doesn't recover from them using "syncdb". You end up with tables that lack entries and it throws my numbers off. Frustrating...

For now I can't even get web_logs to initialize:

2023-10-03 12:18:49,857 - ERROR - An exception occurred while executing the command: The namespace 'canvas_logs' specified in the request is currently not available for querying due to internal errors. (0d39c17c-2842-4465-b9db-f233bb22eee5)