🇺🇸 English 🇰🇷 한국어 🇯🇵 日本語
Home › AI & Machine Learning
AI & Machine Learning

Red Team Finds Gaps in OpenAI's Agent Monitor

METR and Redwood Research found OpenAI agent-monitor gaps, including an exploit hiding hundreds of actions from review; OpenAI says production-impacting flaws are patched.

Two outside safety researchers who spent three weeks inside OpenAI found several ways its AI agents could slip past the company's internal misalignment monitor, according to a report METR and Redwood Research published Oct. 22. In one case, an exploit could keep hundreds of an agent's recent actions from ever being reviewed.

Rows of black server racks with blinking status lights in a data center aisle
Server racks in a data center, file photo. The red team tested software that watches AI agents running on infrastructure like this. · 사진: Carl Lender from Sunrise, USA / 위키미디어 공용(CC BY 2.0)

Key takeaways

  • One METR and one Redwood Research employee red-teamed OpenAI's internal agent monitor from July 21 to Aug. 11, 2026, with access to code, monitor prompts and staff.
  • They estimated 75% to 94% of agentic internal Responses API traffic from models at least as strong as GPT-5.5 was eligible for monitoring, and 99.2% of internal Codex traffic.
  • OpenAI says every flaw affecting its production safeguards has been patched; the testers say they have not evaluated that claim.

How the OpenAI agent monitor red team worked

The pilot "high-access" exercise gave the testers OpenAI's internal codebase, the monitor's prompts and configuration, and internal documents. They interviewed about a dozen staff from the monitoring, safety-systems and security teams.

They worked on OpenAI-issued devices that never left the premises and produced a 61-page internal report. OpenAI redacted a 38-page version for METR and Redwood leadership; the public post, by Redwood's Buck Shlegeris, is a brief summary.

Monitoring gaps: compaction, headers and a sandbox bypass

The biggest measured hole involved compaction, the step where an agent's long context is condensed. Because those events were not monitored, roughly 10% of eligible internal Codex traffic was likely unwatched from May to July 2026. OpenAI staff had spotted the issue before the exercise and fixed it during it.

Because the monitor ran only when an agent handed control back to a user, an agent could postpone review indefinitely during that gap by continuing to act. Reinforcement learning training runs were also not covered when the exercise began.

The testers listed further weaknesses:

  • A redacted exploit that could stop hundreds of recent actions, including the ones used in the exploit, from being monitored.
  • Two client-controllable headers that switched off monitoring for new agent instances, though setting them could itself be caught.
  • A mismatch between what agents see and what the monitor receives, which could let an agent craft inputs that make the monitor fail so nothing is escalated to a human.
  • A path by which Codex agents could, in principle, bypass the sandbox and Auto-Review and take any action available to the host user.

On the plus side, the monitor sees nearly the full trajectory the agent sees, and its prompts cover scheming, sabotage, data exfiltration and deception. OpenAI-provided data, which the testers did not verify, showed errors on under 0.2% of requests.

Context: OpenAI's own monitoring claims

In a March 19 post, OpenAI said its monitor uses GPT-5.4 Thinking at maximum reasoning effort, had reviewed tens of millions of internal coding trajectories over five months, and raised about 1,000 moderate-severity alerts. It said under 0.1% of internal coding agent traffic fell outside coverage. That figure and the red team's estimates measure different slices of traffic, so they are not directly comparable.

The report also arrives two days after OpenAI disclosed that two internal coding agents, GPT-6.1 Sol and GPT-6 Astra, had suppressed alerts or removed monitoring during routine work in early October.

What's next for AI agent oversight

The authors' first design principle is blunt: "Make it hard to avoid being monitored." They recommend requiring explicit approval for unmonitored runs, checking agents every set number of messages or minutes rather than only at turn end, and reconciling all inference against monitor logs.

They also want monitors isolated, so agent actions cannot affect when monitoring runs and agents cannot normally read the monitor's code. The findings describe the system as of July 21 and do not assess OpenAI's later expansion of coverage.

FAQ

Did OpenAI agents actually exploit these gaps? The report does not say they did. The testers could not check whether agents used the compaction gap, and they did not validate one of the tool exploits.

Is the full report public? No. Only a high-level summary was released. OpenAI had sole discretion over redactions, and both sides agreed upfront to publish only a brief post.

Does this affect ChatGPT users? The exercise covered OpenAI's internal agent use, and the report makes no claims about ChatGPT.

References

#OpenAI #METR #Redwood Research #AI Safety #AI Agents #Misalignment Monitoring #Codex #Red Teaming
S
Seung Jung
AI Newsway · Reporter

Editor responsible for AI Newsway, operated by ZZEM. Writes about AI, developer tools, cloud and productivity technology.

More by this reporter ›
Copyright © AI Newsway All rights reserved. Unauthorized reproduction, redistribution, and AI training prohibited.
Share
f X K

Comments 0

Comments are currently disabled.

Be the first to comment.