Missing data

[apritchett]

I noticed this morning that we have a lot of missing data in some of our tables.  I first discovered it in the course_dim and in the course_section_dim.  This causes a problem for us since we run regular reports off of the canvas data.  Has anyone else expereincedthis issue?

[catkins1]

Yes I just noticed this as well the course_dim seems to be missing half the data.

[sam_mcknight]

Same here. About 70% of our account_dim table is missing. I haven't checked the others.

[apritchett · Accepted solution]

I have worked with Canvas and Tableau and I discovered the issue was with Tableau and the way it reads flat files.  For what ever reason Tableau will sometimes have errors reading large flat files.  When these flat feels are moved into a database Tableau does not have the same errors.  We are working to move our Canvas data into a SQL server using the Canvas Data API.

[robotcars]

It's much easier to validate the missing data once you have it in SQL. On at least 2 occasions (file_dim, conversation_dim) I have found some data was missing from our CD files/import. In the event you find data is missing, put in a ticket with Canvas support and the data team will resolve it.