Ex-Anthropic Researcher Jacob Coxon Warns AI Could Grow "Smart Enough to Kill Us"
Coxon said competition among AI developers is pushing companies toward unsafe shortcuts as he left Anthropic two months before his equity vested.
- On Tuesday, AI researcher Jacob Coxon resigned from Anthropic, accusing the company and rival OpenAI of "gambling with our lives" by racing to develop advanced models, notably leaving two months before his equity vested.
- Having spent three years conducting pretraining research at both firms, Coxon wrote on X that those building AI "earnestly believe that it could kill us all by the end of the decade."
- Evan Hubinger, who leads Anthropic's alignment science work, echoed these warnings, stating he agrees AI could pose an existential threat and placing the probability of AI killing all humans within the next decade at above 10%.
- Responding Thursday, an Anthropic spokesperson stated the company has "always been transparent that AI will bring both enormous benefits and unprecedented risks," while Sen. Bernie Sanders plans to introduce legislation halting superintelligence development.
- Anthropic was valued at $965 billion in May and is pushing toward an IPO that could value it near $2 trillion, a valuation Coxon claims he no longer has anything to gain by "juicing up.
36 Articles
36 Articles
At just 27 years old, this researcher from Cambridge, OpenAI and Anthropic found himself at the heart of the global debate this week on the security of artificial intelligence. ...
AI researcher Jacob Coxon quit, fearing extinction. Security experts see a familiar fight
An Anthropic researcher quit over fears of runaway AI. His colleague who still works there agreed. Security experts argue that the incidents that are already on record call for tighter oversight, not panic
AI might take us all down, just not the way you think
"Neither company is acting responsibly," Coxon wrote on X.Imen Ben Youssef / Hans Lucas / AFP via Getty ImagesThis post originally appeared in the Business Insider Today newsletter.You can sign up for Business Insider's daily newsletter here.Please read this newsletter before the end of the world.I don't mean to be dramatic — ok, maybe a little — but there's a lot of AI apocalypse talk these days.An Anthropic researcher's resignation and warning…
Coverage Details
Bias Distribution
- 41% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
























