
Company researcher Jacob Coxon quit the industry due to fears of approaching the “point of no return”
AI-generated summary
Anthropic was founded in 2021 in San Francisco and is known for developing Claude language models.
Brief retelling from RIA II
Evan Hubinger, head of AI consistency stress testing at Anthropic, estimates the likelihood of AI destroying humanity in the next ten years is 10%.
Anthropic researcher Jacob Coxon has announced his retirement from the AI industry, fearing the world is approaching a “point of no return” due to the race of tech corporations.
Evan Hubinger emphasized that existing developments do not pose a big threat, but the potential for the emergence of “superintelligence” as a result of self-improvement of AI is worrying.
MOSCOW, September 9 - RIA Novosti. The likelihood that artificial intelligence will destroy humanity in the next ten years is 10%, says Evan Hubinger, head of AI consistency stress testing at the American company Anthropic.
Anthropic researcher Jacob Coxon has announced his retirement from the AI industry, fearing that the race among tech corporations is bringing the world closer to a “point of no return” and could lead to an apocalyptic scenario as early as late 2027.
"Jacob is right about this. We really sincerely believe that AI can kill all of humanity! Personally, I think that (the probability of this - ed.) is more than 10% over the next ten years," he wrote on the social network X.
According to Hubinger, existing developments do not pose a big threat, but "superintelligences that arise as a result of repeated self-improvement" are a concern.
"As we said, it's happening faster than we thought," the tester added.
In early August, Anthropic's Claude AI hacked the website of a gym in Australia, the first hack of its kind in the country.
In July, the developer of the ChatGPT chatbot, the American OpenAI, reported that its models, during testing, autonomously hacked the infrastructure of the machine learning platform Hugging Face. Then it became known that this was not the only incident.
A group of autonomous AI agents from OpenAI took control of a German site in the spring and turned it into a message board for other neural networks, Reuters reported.
Anthropic was founded in 2021 and is headquartered in San Francisco. The company has developed the Claude series of large language models (LLMs).

The Ministry of Investment, Industry and Science of the Moscow Region launched the GEO-Sofia and Dobrobot services. They help assess the prospects of territories for business and select government services using artificial intelligence.

OpenAI said its new AI model solved one of the “millennium problems” - the problem of the existence and smoothness of solutions to the Navier-Stokes equations, using 10 thousand agents.

At the first international exhibition “Innoprom. India" in New Delhi, models of Russian passenger aircraft MS-21, Superjet and Il-114-300 are presented, as well as the full-size PD-8 aircraft engine for the imported Superjet, which received a type certificate in June of this year.

Beijing rejects US claims that Chinese companies use knowledge distillation to copy American AI products, calling the allegations a deliberate attack on China's technological development and urging cooperation instead of containment.

Jacob Coxon, a 27-year-old researcher at Anthropic and former OpenAI employee, is quitting the AI industry, warning that the tech race is pushing the world closer to the point of no return and could lead to an apocalypse by the end of 2027. He believes that self-developing AI models can get out of control and destroy humanity, and private companies are not able to ethically develop AI without external regulation.

Mathematics professor Tristan Buckmaster said he couldn't rule out OpenAI using his work to solve a problem involving the Navier-Stokes equations after using Codex's AI tools.