AI safety warnings and proposed US AI Force emerge

During the United Nations General Assembly, early Anthropic investor Jaan Tallinn advocated for warnings regarding the existential risks posed by artificial intelligence. Tallinn, who has funded AI safety initiatives for over a decade, expressed concerns that advanced AI systems could potentially end humanity.

In a separate development regarding AI policy, Donald Trump has proposed the creation of an ‘AI Force,’ modeled after the U.S. Space Force, and the appointment of an AI czar. This proposal comes amid a global debate over oversight; while 20 nations have requested human direction and control over AI, the United States was not among them.

While industry leaders such as Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman, and Elon Musk have called for government assistance in slowing frontier AI development, Trump has stated the government should not ‘hinder or stifle’ the industry's growth. This stance contrasts with recent legislative actions in states like California and New York, which require developers to publish safety plans and report incidents.