BackOpenAI Chief Sam Altman Backs Federal Frameworks and Pacing for AI Safety
OpenAI Chief Sam Altman Backs Federal Frameworks and Pacing for AI Safety
Developing
CNBC48 minutes agoTech2 min read

OpenAI Chief Sam Altman Backs Federal Frameworks and Pacing for AI Safety

Altman joins Anthropic's Dario Amodei in warning against recklessness as AI safety debates intensify in Washington and Wall Street.

Quick Look

OpenAI CEO Sam Altman endorsed a federal AI safety framework and model pacing, aligning with Anthropic's Dario Amodei to warn against industry recklessness despite pushback from President Trump.

AI-generated summary

Why It Matters

Safety concerns have grown following researcher departures and rapid advancements in recursive self-improvement.

Font size

OpenAI chief Sam Altman has made his most detailed comments yet on how AI safety frameworks could work, after he joined Anthropic's Dario Amodei and Elon Musk in warning the industry needs to slow down.

"We welcome a federal framework that sets consistent safety requirements for frontier AI," Altman said in a post on X just after midnight on Monday, adding that "no amount of American competitive pressure should justify recklessness."

Altman warned of two ways AI progress could go "very badly", including losing "control of the future to AI" and too much power concentrating around a single person or company.

His X post follows Amodei's essay on Saturday that urged AI companies to slow how quickly they improve their most advanced models.

AI stocks were down on Monday as investors digested the comments. U.S. President Donald Trump said on Sunday a slowdown was not needed and would jeopardize America's lead in AI over China.

Safety concerns have been growing since an Anthropic researcher quit last week, warning the industry wasn't taking it seriously enough, prompting other employees at the lab and rival OpenAI to publicly warn of catastrophic risks.

Meanwhile, lawmakers in Washington are scrambling to address calls for safeguards.

This all comes as Anthropic and OpenAI gear up for what's expected to be historic IPOs. Altman ruled out going public in 2026 in an interview with Fortune published Saturday.

Many AI safety fears revolve around models developing the ability to improve their own performance, a technique known as recursive self-improvement, or RSI.

"Since roughly this summer, AI has been advancing drastically faster, driven primarily by AI's growing ability to build the next generation of AI," said Amodei in his essay. "Left unchecked, it could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all."

Amodei proposed a three-step plan aimed at tempering the pace of development without "sacrificing commercial advantage or the United States' lead in AI."

The plan involves each frontier AI company giving "employee-like access" to external evaluators — which he said Anthropic was committing to now. Amodei also called for frontier AI labs to establish common safety standards, limit the rate of unchecked AI progress and attempt to coordinate efforts globally.

On Saturday, Altman said in a brief X post he agreed with Amodei that AI companies should "pace the frontier." He added that "committing to having independent evaluators with employee-like access is a great idea, and we will do the same.

"Consistent rules to manage frontier risk so that we can maximize the benefits are a good idea (and we are excited by ideas like independent auditors)" Altman said in his Monday post. But, he added, "When we talk about "pacing", we do not mean "stopping". Progress has been rapid and will continue to be."

"Pacing will be well worth this cost; no amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring," he concluded.

"Where we will need the help of our government is for international coordination. But first we should do what we can ourselves."

What to Watch

AI outlook — possibilities, not facts

  • AI labs will implement independent evaluator access.

    Very likely · Within months

Open Questions

  • What specific terms will the federal AI framework entail?
  • How will international coordination on AI safety be enforced?

Related Topics

This article was originally published by CNBC.

Related Stories

Legislator Yang Qiong-ying strives for a national drone testing laboratory to be located in Taichung
Developing·

Legislator Yang Qiong-ying strives for a national drone testing laboratory to be located in Taichung

Legislator Yang Qiong-ying successfully fought for the establishment of a national drone testing laboratory in Taichung, which is expected to be promoted in three years and completed and opened in 2029. The laboratory will be located in the Taichung Branch of the Bureau of Standards and Inspection of the Ministry of Economic Affairs. It will combine the Dadushan precision machinery and aerospace industry clusters to strengthen Taiwan's drone research and development capabilities and international standards.

自由时报
2 min read
Hezhou, Guangxi explores the path of "Wan Shuo He Suan" to lay out the artificial intelligence industry
Developing·

Hezhou, Guangxi explores the path of "Wan Shuo He Suan" to lay out the artificial intelligence industry

Hezhou, Guangxi, is exploring the practical path of "Baan number and computing" and building edge computing power nodes to serve the Guangdong-Hong Kong-Macao Greater Bay Area. From January to July this year, the output value of the core artificial intelligence industry increased by 52.99%, and the total computing power is expected to reach 4884P within the year.

中国新闻网
5 min read
The 4th World Chinese Computational Biology Conference opens in Shaoxing, Zhejiang
Tech·

The 4th World Chinese Computational Biology Conference opens in Shaoxing, Zhejiang

The 4th World Chinese Computational Biology Conference opened on the 14th in Shaoxing, Zhejiang. With the theme of "Artificial Intelligence Empowers Frontier Exploration of Biomedicine", the conference attracted more than 70 Chinese scholars and more than 370 representatives from 7 countries and regions to participate in the conference to explore innovative paths for cross-integration of artificial intelligence and new drug research and development.

中国新闻网
2 min read
More on this topicsam altman