AI Newsway

Anthropic's Browser Use Tool Hands Claude the Page, Not the Pixels

The new Claude API toolset targets elements by reference through the accessibility tree — but developers still supply the browser

|3 min read0
AI Summary
Anthropic released a Browser Use toolset for the Claude API on Thursday under the identifier browser_toolset_20260801, letting Claude name page elements by accessibility-tree handles such as ref_3 instead of guessing pixel coordinates. The developer still supplies and runs the browser, and the 27 default operations cost roughly 6,600 input tokens per request. Watch how teams handle stale references and adapt existing Playwright MCP workflows to Anthropic's format.
A developer laptop — Anthropic's Browser Use toolset runs inside the developer's own browser environment rather than on Anthropic's infrastructure
A developer laptop — Anthropic's Browser Use toolset runs inside the developer's own browser environment rather than on Anthropic's infrastructure

Anthropic's Browser Use toolset does not, despite the name, run a browser. It gives Claude a way to describe what it wants done to a page. The developer supplies the browser, executes every action, and reports back. The toolset went live Thursday for the Claude API under the identifier browser_toolset_20260801. Computer Use, the Skills API and the Files API reached general availability in the same release. Claude Managed Agents does not have access to it.

Coordinates out, references in

Screenshot-based control asks a model to do vision work before it can do the task. Find the button. Estimate its centre. Emit a click at x: 640, y: 320. Browser Use replaces that with text: a read_page call returns the accessibility tree, and interactive elements arrive tagged with handles such as ref_3. Claude then names the handle instead of guessing a pixel.

The gain is precision. The new failure mode is staleness. A handle can go dead the moment the tab navigates or the DOM shifts underneath it. Anthropic's API will not flag that. Catching the mismatch, refusing the action and forcing a re-read is the executor's job.

Where the work lives

That executor absorbs most of the integration effort. It translates operations into real actions, keeps the session alive across turns, and returns enough detail for Claude to follow the consequences. It also runs entirely on the developer's infrastructure. Skills execute inside Anthropic's sandbox and Files API documents live behind Anthropic-issued IDs, but browser sessions, downloads and uploads stay put.

The toolset is not free to load, either. Twenty-seven operations ship by default, costing roughly 6,600 input tokens per request before any screenshot or tree is sent. Applications that will never call half of them can switch the rest off.

Familiar to anyone who uses Playwright

None of this will feel novel to teams already automating browsers. Playwright models pages as ARIA snapshots and finds elements by role. Microsoft's Playwright MCP server has been feeding models referenced accessibility snapshots for a while. Puppeteer reaches the same tree through Accessibility.snapshot().

The concepts line up; the protocols do not. Playwright MCP speaks MCP, Anthropic speaks its own client-toolset format, and an adapter has to translate in both directions. A wholly unrelated open-source project also called Browser Use drives Chromium over the Chrome DevTools Protocol, which is a naming collision and nothing more.

Batching buys speed, spends certainty

Claude can now request several actions in one turn as multiple tool_use blocks. The application runs them in order and answers once. Over a session with hundreds of interactions, that removes a great deal of round-tripping, and with it latency and cost.

Order is not optional, though. If the opening click fails, everything queued behind it targets a page that never existed, so the batch has to stop. Approval flows inherit the problem: a sequence can begin harmlessly and finish somewhere that needs a person to sign off.

Assume the page is hostile

Anthropic's security advice is blunt. Treat the page as hostile. Prompt injection travels in web content, redirects go where they like, and JavaScript that Claude writes inherits whatever privileges the page holds. Run the whole thing in an isolated container or virtual machine with minimal access. Leave JavaScript execution and file uploads disabled until a workflow demonstrably needs them.

How do you feel about this article?

SJ

Discussion

Sign in to post
Loading...

Related articles

Anthropic Unlocks Its Withheld Mythos 5 Model for Defenders, With $35M for Open Source
Developer Tools

Anthropic Unlocks Its Withheld Mythos 5 Model for Defenders, With $35M for Open Source

Anthropic pledges $35M in credits for open-source security and opens Mythos 5, the model it withheld from release, to enterprise vulnerability scanning.

Seung Jung26 days ago
Mixedbread Bets Search Should Be a Cheap Specialist, Not a Frontier Model
Developer Tools

Mixedbread Bets Search Should Be a Cheap Specialist, Not a Frontier Model

Mixedbread launched Toast 1, a specialised search agent it says matches frontier models at up to 10x lower cost and cuts legal-benchmark tokens by 3.5x.

Seung Jung33 days ago
Meta Launches Muse Code, a Terminal Agent for Giant Codebases
Developer Tools

Meta Launches Muse Code, a Terminal Agent for Giant Codebases

Meta's new terminal coding agent enters beta with parallel sub-agents in isolated worktrees, taking aim at OpenAI Codex and Claude Code on cost.

Seung Jung40 days ago
Cloudflare Cut Astro's Open Issues by 85% With Four Agents That Refuse to Share Context
Developer Tools

Cloudflare Cut Astro's Open Issues by 85% With Four Agents That Refuse to Share Context

Separate reproduction, diagnosis, verification and fix agents hand off through a report file, with the original bug reporter acting as the acceptance test.

Seung Jung25 days ago
Slack's New Channel Type Can Only Be Created by a Coding Agent
Developer Tools

Slack's New Channel Type Can Only Be Created by a Coding Agent

Slack Code launches with Claude, Devin, GitHub Copilot and Vercel. Agents open the channels, humans review or stop them, and archives serve as audit logs.

Seung Jung27 days ago
Researchers Found 227 Install Commands Pointing at Code Nobody Owns
Developer Tools

Researchers Found 227 Install Commands Pointing at Code Nobody Owns

A scan of 6,214 domains found 120 llms.txt files pointing coding agents at unregistered packages, and one slot already held live malware.

Seung Jung20 days ago