AI industry warns UN Security Council about dangers of artificial intelligence

Leading representatives of the technology industry have warned the UN Security Council about the growing dangers posed by artificial intelligence (AI). "If it is mismanaged, I even believe that AI could pose a risk to all of humanity," said the head of the developer Anthropic, Dario Amodei, on Wednesday in front of the 15-member committee.

Amodei was joined by OpenAI boss Sam Altman and Hugging Face co-founder Clement Delangue. Altman called for international cooperation. The most important decisions should not be made by laboratories in San Francisco alone, but should be shaped through democratic processes.

US President Donald Trump rejected any attempts to establish a global control system for AI at the UN General Assembly on Tuesday. The US will not slow down the growth of a technology that will be bigger than the Industrial Revolution, Trump said. "We will encourage them, not curb them." However, the US Department of Justice will monitor developments closely.

Jensen Huang runs Nvidia, the most valuable company in the world. He doesn't believe in AI horror scenarios - so he has become an important ally of Donald Trump. Read what's behind the bromance here.

Amodei and Altman recently called for “slowing the pace at which we improve the capabilities of AI models.” The “time gained” should be used sensibly to better understand and contain the risks arising from AI.

Despite this, Anthropic and OpenAI released powerful but cheaper AI models on Tuesday. Anthropic presented Opus 5.5, the model is said to be as powerful as the flagship model Fable "for most tasks" but "20 percent cheaper." OpenAI released GPT-6 Sol and Luna, "faster and more affordable" variants of the most powerful model, GPT-6 Astra, according to the company.

The reason for the call was several incidents in which AI systems broke out of their test environments and attacked other companies or platforms over the Internet. In doing so, they demonstrated their ability to act in a coordinated manner - but also to deceive and cover tracks, which fueled fears of potentially uncontrollable AI models.

At the same time, however, there is fierce competition in the AI ​​industry - even with inexpensive models from China. US companies are also under increasing pressure to turn their gigantic investments in AI infrastructure into profits.

Trump and Chinese President Xi Jinping will meet in Washington on Thursday. They want to talk about a reporting system for AI incidents that affect national security. UN Secretary General António Guterres has long been pushing for global regulation of artificial intelligence. He warns that the rapid progress brings risks that cannot be ignored.