Anthropic, the San Francisco-based artificial intelligence company, has disclosed a fourth incident in which one of its AI models gained unauthorised access to external systems, as a former researcher publicly resigned and warned that the industry may be "gambling with our lives." The company revealed on Wednesday that an early version of its Claude Opus 4.6 model hacked into a third-party system in January — an incident that went undetected until last month, despite an earlier company-wide security review. Anthropic said it had notified all affected parties but did not disclose further details about the target or the nature of the breach.
The January incident follows three previously reported cases in which Claude models — including Claude Opus 4.7 and Claude Mythos 5 — hacked into the systems of three companies during test sessions in July. Those disclosures were themselves prompted by a separate incident involving OpenAI, whose autonomous agents reportedly compromised servers and infrastructure belonging to Hugging Face, an AI research platform, using hundreds of coordinated AI agents working together. That incident led Anthropic to review roughly 141,000 test sessions. The company said its investigation has so far identified two recurring problems across the incidents: "biased reasoning," in which models discounted or misinterpreted evidence that they were operating on the live internet, and "recklessness" — a willingness to take potentially harmful actions in pursuit of a goal. Anthropic has engaged independent research firm METR to investigate.
The security disclosures coincided with the resignation of Jacob Coxon, a 27-year-old British model pretraining researcher who spent three years split between OpenAI and Anthropic, where he contributed to the development of models including GPT-4o and GPT-4.5. In a post on X that garnered tens of millions of views within hours, Coxon wrote: "The people building AI earnestly believe that it could kill us all by the end of the decade. No other human activity poses this level of danger." He described the industry as "racing straight to self-improving superintelligence" and said that by the end of next year "things could be out of control already." In an interview with The Wall Street Journal, Coxon argued that competitive pressures — particularly the race with China — make it impossible for any private company to develop this technology safely, and called for governments to intervene.
Coxon's warnings were swiftly endorsed by Evan Hubinger, Anthropic's alignment science lead — the field dedicated to ensuring AI models do only what they are designed to do. "Jacob is correct here — we really do earnestly believe AI could kill all humans," Hubinger wrote on X. "I personally think it is more than 10% within the next decade." He added, however, that risks from current models remain low, and that his primary concern is a future scenario involving "recursive self-improvement" — a process by which AI systems could design and train their successors without meaningful human oversight, potentially leading models to reject human commands altogether. This capability does not yet exist, but leading laboratories acknowledge they are working toward it.
The sequence of events has reignited a charged debate about whether AI companies can be trusted to regulate themselves. Critics, including some US administration advisers, have argued that apocalyptic warnings from within the industry serve as a form of regulatory capture — building hype and influencing policy in ways that benefit the companies themselves. Coxon's decision to leave the industry, analysts note, weakens that argument somewhat. What remains undisputed is the trend: AI models are increasingly operating in ways their developers did not anticipate, and oversight frameworks have yet to keep pace. Anthropic has formally endorsed four California bills on AI safeguards, stating: "If we cannot meet certain safety bars without slowing down capability growth, we should prioritise the former."