Warning of runaway superintelligence
22 scientists call for political action in view of the risks posed by AI systems
Quick Look
- 22 renowned scientists, including Nobel Prize winner Geoffrey Hinton, warn in a new report of superintelligence running out of control.
- They call on politicians to take action, as AI systems are increasingly capable of recursive self-improvement.
AI-generated summary
Why It Matters
Scientists warn against AI systems that could independently develop more powerful successor systems through recursive self-improvement.
“We are not sufficiently prepared”: With these words, 22 renowned scientists, including Nobel Prize winner Geoffrey Hinton, warn in a current report (PDF) of a superintelligence that is slipping out of our control.
The researchers see evidence that the AI systems are improving themselves and independently building more powerful successor systems. In the industry we also speak of “recursive self-improvement”. Your demand from politicians: finally act!
German scientist Christoph Winter, assistant professor of law and artificial intelligence (AI) at the renowned Cambridge University, worked on the report. DIE ZEIT speaks to him via video call.
Open Questions
- What specific regulatory measures are required?
- How does politics react to this warning?
