started · updated
Anthropic experts warn of AI extinction risk by 2030
Former Anthropic developer Jacob Coxon has resigned, warning that the artificial intelligence industry is moving too rapidly toward self-improving superintelligence. Coxon accused major AI firms of “gambling with our lives” and stated that developers themselves believe the technology could lead to human extinction before 2030.
Evan Hubinger, Anthropic’s head of safety, publicly concurred with these concerns, estimating that the risk of AI causing human extinction within this decade is greater than 10 percent. This sentiment is echoed in broader research; a survey of 1,580 researchers found that half of those polled assigned at least a 10 percent probability to AI causing human extinction or a permanent loss of human control.
The debate has intensified between proponents of rapid development, known as effective accelerationists, and safety advocates calling for stricter regulation. While some argue that AI will be a transformative force for medicine and the economy, others warn of existential risks, loss of control, and the potential for AI systems to act against human interests.
Entities
Anthropic · Claude · Evan Hubinger · Jacob Coxon · OpenAI
Claims
What the coverage asserts, and how many sources carry each claim.
- [○ 1 SOURCE] Half of 1,580 surveyed researchers assigned a 10 percent or greater probability that AI will cause human extinction or permanent loss of control. english.elpais.com
- [● 5 SOURCES] The risk of artificial intelligence causing human extinction within this decade is greater than 10 percent. komputer.dk · komputer.no · kotimikro.fi · pctidningen.se · english.elpais.com
- [● 6 SOURCES] AI companies are not acting responsibly in the race toward self-improving superintelligence. komputer.dk · komputer.no · kotimikro.fi · pctidningen.se · english.elpais.com · +1 more