A concrete example
Claude takes screenshots, spots a button, moves the mouse, and clicks. You tell it "fill in this form," and it does it.
Why it matters
Computer use opens automation to any software, even the ones with no API. A game changer for legacy workflows.
You'll see it in browser agents, visual testing, and some web automations.
Don't mix it up with
Tool use / Function calling: Tool use lets a model call an external tool instead of only replying with text.
Agentic workflow: An agentic workflow is a sequence of steps where the AI plans, uses tools, checks its work, and keeps going until it hits the result.
Common mistakes
- Running it full-screen on your personal computer with no sandbox.
- Thinking it's 100% reliable: it often trips up on complex interfaces.
- Forgetting that it burns through a huge amount of tokens.
Quick checklist
- First I check whether the word names a concept, a tool, a risk, or a metric.
- I tie it to a concrete case: Claude takes screenshots, spots a button, moves the mouse, and clicks. You tell it "fill in this form," and it does it.
- I keep the main trap in mind: Running it full-screen on your personal computer with no sandbox.
Quick questions
What is Computer use in AI?
Computer use lets an AI read a screen, click, and type like a real user.
Where will I run into Computer use?
You'll see it in browser agents, visual testing, and some web automations.
Which word should I read next?
Start with Tool use / Function calling, Agentic workflow, Sandbox.