I took another look at your code and the API docs and was able to get the following to work:

edit_response = requests.put(assignment_url, json={'assignment': {'due_at': new_duedate}}, headers=header)

I made this change based on the parameter names on the Edit an assignment documentation. Since the parameter names were in the form of assignment[due_at], I tried wrapping the fields in an assignment object.