Data and Analytics Group

StevenWalls · 2024-05-13

Just this morning 5/13, we began to sporadically receive the error below when running our table syncs. We have changed nothing on our servers. Has anyone else seen this? ERROR - malformed HTTP response:<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 T...

AlecKulm · 2024-05-10

I have a professor who teaches a course that runs from May to June, so not the full Summer term. When they go to New Analytics it shows that there is no new analytics. We waited the 24 hours like it said and there are submissions from students within...

MikeRichards · 2024-05-06

I was wondering if anyone has found a good way to find course pages (pages that are not directly associated with a learning module) in CD2? I was hoping that content_tags would have a way to do it with content_type and tag_type. So far the best route...

JimEgan · 2024-05-06

For assignments where the points_possible value is set to zero, I see that is a way to create an extra credit assignment. Is there any other explanation for setting up an assignment that way? The reason I ask is that almost 10% of the assignments in...

glparker · 2024-05-03

A quiz in a course had it's due date changed from Feb 18th to March 30th. The teacher insists that they didn't do it, and what I can see in PageViews corroborates this. There are no other teachers or TA or designers in this course, so I suspect...

dogrdon · 2024-05-03

I noticed as of this morning that the handy [PUBLIC]: CD1 to CD2 schema mapping: https://docs.google.com/spreadsheets/d/1kqCXAD9K45L0QeEtbuuMAFp2fW8o0oC8EBzJf58SjrY/edit#gid=822574172 Has been moved to the owners trash (screenshot) Is there a more c...

RichardCarballo · 2024-05-03

Hey all, CD2 has been a big pain implementing for my organization, once we finally got the DAP tool working now we have v1.1 out with this mandatory namespace issues now and a mountain of new errors.With this new 1.1 dap tool, has anyone received and...

JuliePomposo · 2024-04-30

Hi All, I am trying to find where in Canvas Data2 tables can i determine the number of page views a student has on a particular course. I saw a few community page solutions that talks about utilising wiki_page_fact table > view counts seen in this li...

JimEgan · 2024-04-29

I'll state up front that I may not understand the purpose of the OVERRIDDEN columns found in the assignment_overrides table. However, given the documentation associated with the columns, then one or more of the values in the columns appear to be inc...

r_layden · 2024-04-25

Hi I'm looking for advice about working with web_logs and in particular how we might track students' usage through remote_ips. I'm currently maintaining a small server running MariaDB which uses the dap client to retrieve CD2 tables. Firstly - how fe...

JimEgan · 2024-04-24

From the PostgreSQL DDL script for the "assignments" table, the columns EXCLUDE_BIBLIO and EXCLUDE_QUOTED have the same comment. Here's the comment: Selecting this option will exclude text appearing in the bibliography, works cited, or references s...

NoorRashid · 2024-04-24

Hi Folks!After running into the issue of no data being inserted after syncdb, I reinstalled everything, including python, DAP client, PostgreSQL and upgraded to tsv2py 0.6.2. That seemed to solve the issue of *no* data being inserted into my PostgreS...

JosephPolich · 2024-04-22

Has anybody that was using the Harvard Data 1 extract successfully converted it to use Data 2 and was it just changing the API data?

lschmidt71 · 2024-04-18

We are looking to download certain table data, transform it, and then upload to our Azure DataLake storage.The solution I have been working on involves a Python Azure Function app. Since the DAP parquet files have a "key", "value", and "meta" columns...

DeliaGeorgescu · 2024-04-18

In a course's People list, each user has their total activity (hh:mm:ss) listed. Is there any way a teacher in the course could export this data as a report? Or as an admin, for the entire account activity? It would be ideal if admins could report on...

NoorRashid · 2024-04-17

Good morning folks!After updating to the new stable release of the DAP CLI tool, I was able to smooth out some existing issues which some of you have already experienced:TCI_KEEPIDLE issue was an OS/Python issue "Please use initdb" when trying to use...

raoshriya96 · 2024-04-16

I'm trying to extract all clicks to a specific URL from web logs, with user ID-level detail. However, when filtering the logs to that URL, I noticed some users have multiple records (5-10) with timestamps only a few seconds apart. This suggests repea...

Pete5484 · 2024-04-15

Hi - I'm using DAPClient 1,1 and postgres 16 With an incremental query I've discovered we seem to have started losing pseudonym "id"'s. e.g. users.id 2720 has pseudonym.id 2689, but in the pseudonymn table 2689 has been skipped, so has 2693. Confirme...

nhumphries · 2024-04-11

Hi, Does anyone have any idea how to track the usage of SCORM packages across the entire instance. I need the number of packages deployed and the number of courses that have at least one package deployed

vsenior-cvc · 2024-04-09

To follow standard best practices in online courses, we require our facilitators to send welcome messages (sometimes more than one) to participants before the course is published. The roster in grades and people shows student logins or SIS ID's (whi...

StevenWalls · 2024-04-09

On several table downloads using initdb I'm getting dozens of the error below. This has only been on a few tables so far. I have tried dropping the table and re-running, that worked once but not on the conversation_messages table. We're using Python...

vsenior-cvc · 2024-04-04

It would be immensely helpful if the Canvas Sys Admin (or course teacher if that was possible) was able to see the progress New Analytics was making. If it goes over 24 hours, usually teachers will contact support thinking something is wrong, and th...

burkepk · 2024-03-29

Hello all, our team is new to developing solutions to pull data from Canvas. I have been lurking in the forums for a bit, trying to gather as much information I can to set up the correct tools that we would need to be successful. However the one pa...

cdellapietra · 2024-03-29

Hi All,Our group recently rebuilt our entire Canvas database with the release of DAP 1.1.0 (we were behind and using a deprecated version until that point). After dropping and initdb'ing all our tables again, everything was working again, with the ex...

Givan · 2024-03-29

Hey Community,I’m currently trying to migrate my application to use Canvas Data 2 and I’ve been running against a problem and was wondering if you could help.Example:RootAccountSubAccount1Account1Account2SubAccount2Account1Account2I want to retrieve ...

NickChevalierUT · 2024-03-28

Confession: I am not a developer or an SQL expert, but I can view certain kinds of code, sort of learn it, and make adjustments as needed. Otherwise, I rely heavily on ChatGPT, particularly when it comes to SQL.  That said, I was wondering if someon...

ByambaBird · 2024-03-27

When we are running our DAP synchronizer python script, we are running into issues going back to Feb 27. This was the last time it ran successfully and we noticed it 2 days ago. When diving into the issue we are finding that several tables now are tr...

AzJedi · 2024-03-27

Hello Community,I'm currently working with the DAP CLI tool to import Canvas Data 2 into a database, but I'm running into an issue where the tables and column headers are created successfully but the table rows remain empty. This is after running the...

saustin · 2024-03-22

Good afternoon, PostGres SQL queries using Canvas Data 2 for the public table, submissions column, submitted_at field returns inaccurate dates. Below is an example of the results of a submitted_at field for a student in a class. The top is null bec...

lmsstaff · 2024-03-22

In v1.1 of the newly released dap client, there is now a decompress parameter in the API. Is there a plan to include this parameter in the CLI version of the dap client? I love this feature and have a workaround in place to change the default to Tr...

Data and Analytics Group

Data and Analytics Documentation

Data and Analytics Group Discussions

"Malformed HTTP response"

Canvas New Analytics Not Working

Finding Course Pages and Module Pages separately

Assignment Points Possible Zero Other Explanation?

How do I know which person changed the due date on an assignment/quiz

CD1 to CD2 schema documentation Deleted

CD2 dap issues

How to Access Page Views using Canvas Data 2 Tables

Assignment Override Flags Are Often Incorrect

web logs and remote_ips

Duplicate Comment For Different Columns

CD2 issues continue - table initdb inserts only fraction of data

AWS Harvard Data 1 extract conversion to Data 2

DAP parquet file transformation strategy

Total Activity Report

pysqlsync - no rows to upsert/insert - tsv2py not solving issue, syncdb not...

CD2 - Weblogs

Incremental query with missing pseudonym entries

SCORM Usage in Data 2

Obtaining Roster emails: Allow New Analytics to run before publishing the ...

Error running initdb with DAP 1.1

Give System Admins ability to see progress on Course New Analytics

Setting up DAP Synchronization in AWS, Fargate or Labmda?

Canvas Data 2 Schema Out of Sync?

(Canvas Data 2) Is it possible to scope on SubAccounts?

Canvas Data 2 Query Review

DAP Client syncing tables returning "pysqlsync base QueryException": column...

DAP CLI Tool Imports Structure but No Data into Tables

Canvas Data 2 public table submissions column submitted_at returns inaccura...

Decompress parameter in the dap client v.1.1

You're signed out

Data and Analytics Group

Data and Analytics Documentation

Data and Analytics Group Discussions

Community Help

View our top guides and resources: