Issues with Canvas Data 2 API Files download
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I’m working with Canvas Data 2 API and am having trouble accessing S3 files programmatically. While I can manually open the provided URLs in my browser, I receive a 403 Forbidden error when trying to access them using Python.
I’ve been provided with an S3 link to a file, but I can’t retrieve the file using Python. Here is a typical URL I’m working with:
https://data-access-platform-output-prod-iad.s3.amazonaws.com/output/...
When trying to access this URL using Python with requests or urllib, I consistently receive a 403 Forbidden error. However, I can access this URL successfully in the Brave browser.
Attempts:
- Basic HTTP GET Request
import requests
url = 'https://data-access-platform-output-prod-iad.s3.amazonaws.com/...'
response = requests.get(url)
if res... - Including Headers
canvas_req_headers = {
'User-Agent': 'Mozilla/5.0 ...',
'Referer': 'https://data-access-platform-output-prod-iad.s3.amazonaws.com/...'
}
response = requests.get(url, head...
Can anyone provide guidance on how to access these files programmatically? Are there specific headers, authentication methods, or additional steps required for programmatic access that might not be needed for manual access?
