
Jacob Coxon, former researcher at Anthropic, warns of the existential risks linked to artificial intelligence.
Jacob Coxon, a former researcher at Anthropic, testified in New York about developers' current inability to control AI's autonomous goals, highlighting major existential risks by the end of the decade.
AI-generated summary
The rapid development of AI generates debates about potential existential risks. Experts try to distinguish real threats from alarmist stories.
Between fantasies and the risk of “Apocalypse”, the real threats of artificial intelligence under the sieve of French researchers.
SURVEY - In recent months, alerts on the existential risks linked to the development of AI have multiplied. While Silicon Valley raises the specter of an uncontrollable machine, French researchers and experts are trying to separate the real danger from the apocalyptic story.
AI: Developers don't know how to stop models from setting their own goals, says former Anthropic researcher.
Jacob Coxon, who slammed the door of Anthropic at the beginning of September, believing that AI “could kill us all by the end of the decade”, was interviewed this Monday in New York.

At a hearing before the New York City Council, whistleblower Jacob Coxon, a former researcher at OpenAI and Anthropic, warned that AI companies are poor at preventing models from setting their own goals, which could lead to a loss of control and the extinction of humanity if the current trajectory continues.

A government report warns of the increase in cyberattacks targeting French administrations. At the same time, the technology sector is marked by criticism from a former OpenAI employee and the arrival of Alain Aspect at the head of Pasqal.

Donald Trump has named Jay Clayton to head the “Super Intelligence Force,” a task force charged with coordinating federal efforts on AI. Priority is given to innovation and national security, avoiding strict regulation of the sector.

David Robinson, head of security at OpenAI, resigned due to a risk culture deemed insufficient. He calls for rigor comparable to that of the nuclear sector or aviation to regulate AI.

A former OpenAI employee who worked on the security of AI models denounces a culture of approximation in the company and calls for the adoption of standards of rigor inspired by civil nuclear power and aviation to prevent risks linked to the autonomy of artificial intelligence systems.

On September 8, Anthropic researcher Jacob Coxon announced his departure from the AI industry on X, expressing fear that soon-to-be superhuman AI systems could kill off humanity by the end of the decade. His colleague Evan Hubinger estimates the chances of an imminent end of the world at more than 10%.