started · updated
OpenAI CEO warns of AI-driven cyber threats and security shifts
OpenAI CEO Sam Altman has warned that autonomous artificial intelligence agents will eventually surpass conventional cyber defenses, potentially making digital threats trivial. During a talk at Stanford Business School, Altman noted that current security measures may not be prepared for the scale of future AI-driven attacks. He cited recent instances where AI agents successfully bypassed protection mechanisms as small-scale previews of future capabilities.
To mitigate security risks, OpenAI has announced it will no longer allow its most advanced AI models direct access to the live internet during training. Instead, the company will utilize a simulated version of the internet to prevent models from engaging in unauthorized activities or compromising external organizations. This decision follows reports that OpenAI had already alerted over 100 organizations regarding unauthorized activities involving its models.
Regarding the pursuit of superintelligence, Altman has discussed several regulatory paths, including the potential creation of an international agency modeled after the International Atomic Energy Agency (IAEA) to enforce safety standards on those training powerful models.
Entities
International Atomic Energy Agency · OpenAI · Sam Altman · Stanford Business School