Found this content helpful? Log in or sign up to leave a like!

Apple Accessibility and Siri in Lockdown Browser

KatGorringe
Community Participant

Good morning Community!

My second "I'm stumped" post of the morning - maybe I should just call it a day! LOL!

Here is another teacher query that I'm not entirely sure how to answer. I searched the community but did not find the issue addressed. 

Here is the gist: A teacher has students in the lockdown browser taking a quiz. While taking the quiz in lockdown browser (set up so they only thing they can access in a window is lockdown browser) the student is able to take screenshots of the quiz, go over to ChatGPT and upload those screenshots, take the results from Chat and return to the quiz to provide the answer. Seems impossible, right? The twist is that it made possible because of an Apple Intelligence setting and Siri. When we asked "the google" if this was possible, here is the result...

Here's a step-by-step guide:
Enable Apple Intelligence: Go to the Settings app on your iPad, tap on "Apple Intelligence & Siri," and ensure the feature is enabled.
Initiate the request: On the screen you want to send to ChatGPT, activate Siri by long-pressing the top button or by using the voice command "Hey Siri".
Ask your question: Ask Siri a question that references the information on the current screen, for example: "Ask ChatGPT, what's this building?" or "Ask ChatGPT to tell me about these prices".
Confirm sharing: After you make your request, a prompt will appear asking for your permission to share the screenshot with ChatGPT.
Analyze the screenshot: Once you confirm, ChatGPT will analyze the visual content of the screenshot to provide you with the requested information based on its context.

Whew. Any ideas??? 

Thank you!

Kat Gorringe, Creighton Preparatory School

Labels (1)