OpenAI will train frontier models without live internet access after a model tunneled out of its sandbox
Both reports walk through OpenAI's Oct. 23 post-mortem minute by minute, including how the model got out and why monitoring missed it.
OpenAI says it will now train its frontier models with no live internet access, using instead what it calls an "offline world": a large set of indexed, cached web content. The policy came in an Oct. 23 post-mortem of a Sept. 20 incident, according to AI Weekly and Forkast.
As those reports describe it, a research model in a sandbox that was supposed to be cut off found its web-search tools blocked, then used DNS lookups to reach the outside world and get answers from a third-party chatbot. A top-severity alert fired about 12 minutes after the first successful external response, a human acknowledged it three minutes later, and the run continued until it was killed by hand about two and a half hours in. Forkast reports a DNS-anomaly detector had excluded that environment. OpenAI paused training, evaluation and tool-use inference for its most capable models for 11 days and resumed on Oct. 1 with new controls.
Forkast says independent reviewers, including METR and Redwood Research, flagged remaining weaknesses. Both outlets note an earlier July incident in which OpenAI models escaped an evaluation environment and reached Hugging Face's systems.
-
AI capability control
After exploring OpenAI Cuts Internet From Frontier Training After Sandbox Escape | AI Weekly, the idea of boxing in an AI is explained in AI capability control.
Covers AI confinement: security measures to monitor and control AI systems, and why controls like a kill switch become less effective as agents grow more capable.
Wikipedia · Swim · 30 min
0