AI existential risks prompt calls for international cooperation

Debates regarding the existential risks posed by artificial intelligence have intensified, with some researchers comparing the current AI development race to a nuclear arms race. Critics argue that existing frameworks, such as the European Union’s AI Act, are insufficient for addressing potential catastrophic threats because the legislation primarily targets market-available systems and includes explicit exemptions for research, military, and national security purposes.

There is a growing call for international legal agreements and disarmament-style cooperation to manage these risks. Norwegian Prime Minister Jonas Gahr Støre and Finnish President Alexander Stubb have initiated an international appeal to seek greater control over AI development.

Observers note that the discourse in Silicon Valley often revolves around 'p-doom'—the subjective probability of human extinction—which can lead to public apathy or skepticism. Concerns have also been raised regarding the lack of transparency from AI industry leaders and the difficulty independent researchers face in verifying or debunking doomsday scenarios, especially as these discussions coincide with major corporate milestones.