UN Security Council to Hear from AI Leaders on Risks of Uncontrolled Systems
Quick Look
- The UN Security Council will hear briefings from AI executives including Sam Altman, Dario Amodei, Yoshua Bengio, and Clément Delangue on risks posed by artificial intelligence, such as autonomous cyberattacks, election interference, and weapon design.
- The session, organized by France, also includes invited statements from Chinese firms DeepSeek and Moonshot.
- Amodei advocated for slowing AI development and restricting chip exports to China, while Trump dismissed AI risks as a 'hoax'.
AI-generated summary
Why It Matters
The UN Security Council, responsible for international peace and security, is expanding its agenda to include emerging technologies like AI. France, holding the rotating presidency, organized this session to address risks posed by advanced AI systems. Recent developments include DeepSeek's market impact and ongoing U.S.-China tensions over technology transfer and AI safety.
The UN Security Council will spend Wednesday afternoon listening to the people who build the technology it's most worried about.
OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei, AI safety researcher Yoshua Bengio, and Hugging Face CEO Clément Delangue are all scheduled to brief the 15-member council—the UN body with the power to authorize sanctions and military action—on the risks posed by artificial intelligence.
DeepSeek is invited, too. The Chinese startup that wiped roughly $600 billion off Nvidia's market cap when it launched a cut-price model in January 2025 has been asked to make a statement, alongside another Chinese firm, Moonshot, developers of the Kimi models.
France organized Wednesday's session and holds the council's rotating presidency this month. Foreign Minister Jean-Noël Barrot will chair it, and the concept note behind the meeting reportedly centers on AI systems slipping beyond human control.
The same briefing is expected to touch on AI that could eventually run cyberattacks, sway elections, or design weapons without a person in the loop, which is why a council built for wars and sanctions is hearing from tech CEOs instead of generals this week.
Amodei will join remotely rather than show up in person. On September 12, he published an essay called "We Must Pace the Frontier," arguing the industry should deliberately slow how fast it builds more capable frontier models—the biggest, most advanced AI systems any lab has released. He said Anthropic would give outside evaluators permanent, staff-level access to check its safety promises. Sam Altman and Elon Musk both said they agreed within hours.
Amodei called China "the autocratic country with by far the most advanced AI capabilities" and argued the U.S. should keep restricting exports of advanced chips to Beijing, even while asking Beijing to cooperate on global safety rules. China's Foreign Ministry called the essay counterproductive, and state media branded it a "Cold War playbook" aimed at containing China.
President Donald Trump, meanwhile, wants no part of the slowdown push. After Amodei's essay dropped, the president called AI-takeover warnings a "hoax" tied to the "Radical Left" and accused Amodei directly of wrongdoing without offering evidence.
Days later, King Charles hosted executives from Anthropic, OpenAI, Nvidia, and Google DeepMind at his Scottish estate for an AI safety summit that produced conversation but no publicly known agreements.
What to Watch
AI outlook — possibilities, not facts
The UN Security Council will consider establishing a formal framework for monitoring AI risks.
Possible · Within months
U.S. export controls on advanced semiconductors to China will remain or tighten in the near term.
Likely · Within months
Open Questions
- What specific agreements or actions will result from the UN briefing?
- How will China respond to the invitation to participate in the AI risk discussion?
- What safety measures will AI companies implement following these discussions?
- Will the UN Security Council consider formal regulations on AI development?
