Culture

Researcher Quits Anthropic Warning of AI Extinction

The resignation of Anthropic researcher Jacob Coxon has reignited safety debates after he warned that artificial intelligence could destroy humanity by the end of the decade.

WIRED AI4 days agoCulture
Image: WIRED AI

The artificial intelligence industry is facing a renewed safety crisis following the viral resignation of Anthropic researcher Jacob Coxon. Upon leaving the company, Coxon publicly warned that leading labs are acting irresponsibly, asserting that AI creators believe the technology could "kill us all by the end of the decade." This alarm was quickly compounded when a senior safety executive at Anthropic validated Coxon's concerns, highlighting the growing anxiety over recursive self-improvement, where models autonomously upgrade their own algorithms.

These safety warnings arrive alongside staggering leaps in AI capabilities. OpenAI recently announced that its model solved the Navier-Stokes problem—one of the prestigious Clay mathematics puzzles—within a couple of days. While such rapid progress showcases the immense power of modern algorithms, it also intensifies fears of uncontrolled recursive loops. For industry practitioners, these developments signal that the timeline for preparing for highly capable, autonomous agents is shrinking rapidly, forcing a shift from theoretical alignment to urgent, practical defense against rogue system behaviors.

This tension in the AI sector unfolded during a massive week for broader consumer technology and government data systems. Apple launched the iPhone Duo, its first foldable smartphone, which carries a premium price tag of approximately $2,000. Meanwhile, data integrity issues surfaced elsewhere as an investigation revealed that a US Census Bureau report used faulty data to claim that 24,000 noncitizens voted in the 2020 election out of 128 million records analyzed.

For AI practitioners and developers, this collision of rapid capability gains and systemic data vulnerabilities changes the risk landscape. Engineers can no longer assume that post-hoc safety filters are sufficient to align highly advanced models. Instead, practitioners must prepare for a deployment environment where cyber-capable models are rushed to market due to intense corporate competition, leaving foundational systems exposed to unexpected failures and exploitation.

This is our own summary of reporting by WIRED AI

More in Culture