Nvidia CEO Jensen Huang says AI firms should self-regulation is sufficient for AI safety
Quick Look
Nvidia CEO Jensen Huang argued at a Salesforce conference that AI companies should self-regulate safety, rejecting calls for new laws and stating that executives should pause releases if they lack confidence in their products, contrasting with industry figures who warn of existential risks and advocate for government oversight.
AI-generated summary
Why It Matters
Nvidia has become the world's most valuable company due to surging demand for its AI chips, while internal debates intensify over whether AI development poses existential threats requiring regulation or can be managed through industry self-policing.
The heads of artificial intelligence (AI) firms should decide if new versions of the technology should be released, Nvidia boss Jensen Huang has said in response to growing concerns about AI's threat to humans.
"We don't need new laws or regulations," Huang said, adding that there should not be a "false choice" between the speed of innovation and the safety of AI products.
Nvidia is the biggest company in the world by valuation, with its profits having boomed as a result of rampant demand for the AI computing chips it makes.
Huang's stance on AI safety contrasts with those in the industry who have recently expressed fears that the technology could wipe out humanity.
A post from an artificial intelligence researcher who quit AI firm Anthropic went viral last week after it claimed AI could kill all humans by the end of the decade if left unchecked.
Other AI executives and experts responded saying they agreed. Then, over the weekend, Anthropic chief executive Dario Amodei called for the pace of all AI development to slow, external and urged governments to regulate the industry.
The post was applauded by OpenAI chief exuecutive Sam Altman, co-founder of Google's DeepMind Demis Hassabis, and Elon Musk, owner of social media site X and AI assistant Grok.
However, some industry figures have said the fears were overblown and were being jumped on to generate hype for the industry.
Addressing the potential dangers of AI at a salesforce conference in San Francisco on Tuesday, Huang referred to current advances as "a new industrial revolution" but insisted that AI companies should be left to essentially regulate themselves.
"Safety is paramount. However, safety is an engineering problem," Huang said.
He added that if at any time a leader of an AI company lacks confidence in their product they should choose to not release it.
"That's a very obvious thing to do," Huang said. "Run as fast as you can, but if at any time you feel the institution is not in control, take a pause."
The idea of AI executives being left to entirely regulate themselves has struck some in the industry as a bad idea.
Jack Clark, an Anthropic executive and co-founder, told the BBC on Monday that leaving AI to be a "totally unregulated industry" was "rolling dice with immense risks".
Patrick Hillman, the chief operating officer of Logical Intelligence, which is chaired by Yann LeCun, a sage of the AI industry, noted Tuesday how little faith people have in tech companies to do anything truly in the public interest, external.
"The only institution that Americans might trust less than Washington these days is Silicon Valley. I have worked and lived in both and I assure you both have earned this scepticism," Hillman said.
"If you believe what you are building is dangerous, show us what you are prepared to stop doing," he added.
What to Watch
AI outlook — possibilities, not facts
AI companies will face increasing public and governmental pressure to adopt external safety oversight
Likely · Within months
Nvidia's market position may be affected if AI safety incidents erode public trust in the industry
Possible · Within months
Open Questions
- What specific safety benchmarks would trigger a pause in AI releases according to Huang?
- How would self-regulation be enforced across competing AI firms with differing risk appetites?
- What evidence exists that tech companies can effectively self-regulate in the public interest?
