GPT-6.1 Terra: reading a screen is only part of the job

Transcript

The original narration, preserved as published. Relative dates refer to the episode’s coverage window.

Your screen-reading agent can still click the wrong thing. OpenAI released GPT six point one Terra today, aimed at visual reasoning and computer use. Reading the screen is only one part of completing the job.

The model accepts text and images and returns text. OpenAI lists product-photo matching, technical drawings and application screens as uses. A screenshot can provide evidence, but it does not make the next action correct.

Tool calling requires the Responses API. Your application connects the model to tools and decides how actions are executed. The model's visual understanding and the surrounding software have to work together.

For a trial, use a screen task with a known outcome. Record which item the agent selected, what it changed and whether the result matches the request. This is our suggested evaluation, not a reported Terra benchmark.

We have not independently tested the model. It does not accept audio or video as model inputs. Watch wrong clicks and completed tasks on real application screens, rather than judging a polished explanation of what the agent intended.