AI industry under pressure: debate about security risks and deceleration
OpenAI boss Sam Altman and industry representatives discuss the existential risks of artificial intelligence and possible regulations.
Quick Look
- OpenAI boss Sam Altman and other AI greats debate the existential risks posed by AI.
- While Anthropic boss Dario Amodei calls for a slowdown in development, the role of state regulation between the EU and USA remains controversial.
AI-generated summary
Why It Matters
AI companies are under pressure to minimize security risks when developing powerful models. There is a debate about the need for slowdowns and government oversight.
Sam Altman, OpenAI CEO:
“I believe it is unacceptable to take a ten percent risk that humanity will be wiped out by the end of the decade – obviously.”
Is what OpenAI CEO Sam Altman is saying here about the development of artificial intelligence really still so obvious?
This week, an AI researcher at Anthropic, who had previously worked for OpenAI, resigned. He warned that both companies were “playing with our lives.” They themselves believe that AI could wipe out humanity by the end of the decade.
In an interview with Fortune magazine, OpenAI CEO Altman also addressed this issue.
Alyson Shontell, Fortune:
“Do you believe that ten percent figure is accurate?”
Sam Altman, OpenAI:
“No, I still don’t. But whether it’s ten or eight or six – we have an enormous responsibility and cannot let egos or the pursuit of profit or anything else stand in our way. We must act in such a way that we do not take on such a risk.”
Altman has postponed OpenAI’s planned initial public offering.
Sam Altman, OpenAI CEO:
“Given everything currently happening with regard to safety, an IPO would be unwise at this time.”
However: The move had been expected for weeks – not due to safety concerns, but because of the company’s weak financial figures.
Nevertheless, the industry now wants to hit the brakes. Anthropic CEO Dario Amodei published a blog post calling on the entire AI industry to slow down the development pace of its most powerful models “so that risk prevention can catch up.” He wants to allow independent auditors into his company.
The major danger: an AI that continuously develops itself, entirely without human influence, and thus gets out of control.
Altman welcomed his competitor’s call for brakes, as did Google. Even Elon Musk agreed – the man who views safety measures through state regulation as a problem rather than a solution.
Elon Musk, xAI founder:
“It needs an environment that is relatively free from regulation. In the EU, for example, we find the level of regulation extremely high. There, things are inherently illegal from the start.”
In the US, home to the leading AI companies, the situation looks different – thanks to Donald Trump, who is betting on deregulating the industry.
How seriously the AI world ultimately means its own deceleration in the interest of safety – that will likely become clear only in the coming weeks and months.
What to Watch
AI outlook — possibilities, not facts
Further debates about AI regulation in the USA and the EU.
Very likely · Within months
Open Questions
- How are independent auditors defined in the AI industry?
- How do the different regulations specifically affect AI development?
