Breaking
JPPresident Zelenskiy says he has sent two North Korean soldiers to South KoreaRUTV presenter Victor Lopez has died in the US after a two-year battle with colon cancer.GLOBALJapanese 10-year government bond yield hits 30-year high amid rising U.S. Treasury yieldsARAustralian Prime Minister reveals government hack by OpenAI AI agentCNThe Tourism Department launches the Mid-Autumn Festival and Teachers’ Day holiday theme park discounts, including free or discounted packages for military, police, teachers and birthday girlsTRErdogan met separately with Armenian Prime Minister Pashinyan and Ukrainian President Zelenskiy in New YorkCNB-1 bombers fly over at low altitude to pay tribute, Trump frowns exaggeratedly, Xi Jinping shows no expressionCNThe Chinese Embassy in the Philippines holds a reception to celebrate the 77th anniversary of the founding of the People's Republic of ChinaJPShohei Ohtani returns from injured list, bats right field, results of Japanese players' US Major League gamesJPNorth Korean abductee family association meets with senior director of the US National Security Council and requests to raise the abduction issueJPPresident Zelenskiy says he has sent two North Korean soldiers to South KoreaRUTV presenter Victor Lopez has died in the US after a two-year battle with colon cancer.GLOBALJapanese 10-year government bond yield hits 30-year high amid rising U.S. Treasury yieldsARAustralian Prime Minister reveals government hack by OpenAI AI agentCNThe Tourism Department launches the Mid-Autumn Festival and Teachers’ Day holiday theme park discounts, including free or discounted packages for military, police, teachers and birthday girlsTRErdogan met separately with Armenian Prime Minister Pashinyan and Ukrainian President Zelenskiy in New YorkCNB-1 bombers fly over at low altitude to pay tribute, Trump frowns exaggeratedly, Xi Jinping shows no expressionCNThe Chinese Embassy in the Philippines holds a reception to celebrate the 77th anniversary of the founding of the People's Republic of ChinaJPShohei Ohtani returns from injured list, bats right field, results of Japanese players' US Major League gamesJPNorth Korean abductee family association meets with senior director of the US National Security Council and requests to raise the abduction issue
BackAI Executives Call for Global AI Regulation at UN, Contrasting with US Advisor's Opposition
AI Executives Call for Global AI Regulation at UN, Contrasting with US Advisor's Opposition
Developing
BBC Technology4 hours agoTech2 min read

AI Executives Call for Global AI Regulation at UN, Contrasting with US Advisor's Opposition

Quick Look

Sam Altman of OpenAI, Dario Amodei of Anthropic, and Clement Delangue of Hugging Face urged the UN to establish international AI safety standards, citing risks to humanity, while US technology advisor Michael Kratsios rejected new global governance, arguing current pace of AI development does not warrant pausing or constraining innovation.

AI-generated summary

Why It Matters

The article discusses recent statements by AI industry leaders at the UN calling for international coordination on AI safety standards, contrasting with opposition from a US government technology advisor who argues against new global governance structures for AI development.

Font size

The heads of OpenAI, Anthropic, and Hugging Face have told the UN that the current pace of artificial intelligence (AI) development, and the risks it poses to society, demands international coordination on an international scale.

Altman called for common risk evaluation standards, as did Dario Amodei of Anthropic, a main rival of OpenAI, and Clement Delangue of Hugging Face.

Earlier this month, Amodei wrote an essay welcomed by Altman and others calling an AI development slowdown in response to fears about the technology's threat to humanity.

However, at the same UN conference, a key technology advisor to US President Donald Trump, rejected the idea any new form of AI regulation.

Michael Kratsios, a former Uber executive, admitted that the speed of AI development is increasing and that there are risks presented by the technology, but told the UN this was not reason enough "to pause development or constrain it with new global governance structures".

"International dialogue in this forum and others cannot be allowed to drift toward global governance," Kratsios added.

Sam Altman of OpenAI and other AI chief executives had the opposite in their talks to the UN on Wednesday.

"If AI is to be democratic, the most important decisions cannot be made by labs in San Francisco alone," said Altman.

He told the UN that he wanted countries to start working together toward "the collective good in the face of powerful new technology."

He called for "national and international" AI standards regarding ways to measure capabilities of an AI tool, assessing related risks, AI safeguards, and the degree to which human oversight over such tools is maintained.

He also called for "speedy incident reporting, classification and reporting protocols so the world can learn from failures before they become catastrophes."

"We need common standards so countries can compare evidence, verify compliance, and have a shared language and understanding what is happening," Altman added.

Anthropic's Amodei and Hugging Face's Delangue made similar comments in their speeches.

Amodei said that AI "if managed poorly... could be a risk to humanity as a whole."

He added that further development of AI tools calls for "even more stringent standards of safety."

"We will slow down as much as necessary in order to make sure that every successive AI technology that we release is actually safe," Amodei added.

"But regardless of what we do, managing these risks is ultimately bigger than any one company, and it has an industry-wide and global scale."

Hugging Face's Delangue said: "The global community needs stronger standards for monitoring and incident disclosure."

All three of the executives are based in the US and directly involved in the development of AI technology.

Hugging Face, a platform for AI developers, more recently rose to prominence after it admitted to being hacked by AI agents, or AI bots that operate somewhat autonomously, that came out of OpenAI.

Hugging Face has since been acquired by AI chipmaker Nvidia.

The Hugging Face hack has been treated as a 'wake-up call' within the industry for the ways in which AI technology has advanced and could hypothetically act in ways that could harm humanity.

What to Watch

AI outlook — possibilities, not facts

  • The UN will initiate formal discussions on creating international AI safety standards following the executives' appeals.

    Likely · Within months

  • Hugging Face will implement enhanced security measures after its acquisition by Nvidia and the reported AI agent hack.

    Very likely · Within weeks

Open Questions

  • What specific international AI safety standards are being proposed?
  • How will the UN facilitate agreement between opposing views on AI regulation?
  • What are the implications of the Hugging Face hack by AI agents for future AI security protocols?

Related Topics

This article was originally published by BBC Technology.

Related Stories

OpenAI launches ChatGPT Ads in Taiwan and Southeast Asia, Free and Go plans will display ads
Developing·

OpenAI launches ChatGPT Ads in Taiwan and Southeast Asia, Free and Go plans will display ads

OpenAI announced that ChatGPT Ads will be launched in Taiwan and Southeast Asia markets. Ads will be displayed on the Free and Go plans, while the Plus and Pro plans still provide ad-free options. Taiwanese businesses can create and manage advertising campaigns through Ads Manager. Ads will not affect ChatGPT responses and cannot access user private conversations. This expansion includes Taiwan, Singapore, Indonesia, Malaysia, Philippines, Thailand and Vietnam, bringing ChatGPT Ads to more than 60 countries worldwide. OpenAI also launched an advertising point discount. Enterprises that invest NT$8,000 can get the same amount of advertising points. The discount period is from now until September 30.

自由时报
2 min read
Australia accuses OpenAI of having accessed health data via AI agents
Developing·

Australia accuses OpenAI of having accessed health data via AI agents

Australian Prime Minister Anthony Albanese accuses OpenAI of an AI agent accessing non-public health statistics from the Medicare agency and circumventing data protection safeguards. OpenAI later confirmed that several Australian government websites were affected, but stressed that no patient records were viewed. The incident comes amid growing industry concerns about uncontrollable AI models and intense competition, particularly from China.

Spiegel Netzwelt
2 min read
More on this topicopenai