Google DeepMind Paper: AI Consciousness Debate Poses Political, Not Technical, Challenge

As AI becomes increasingly embedded in daily life, a new paper from Google DeepMind argues that one of the technology's most difficult challenges may be political rather than technical.

In the study, “Artificial Minds, Human Disagreement: The Political Challenge of AI Consciousness,” researchers Adam Bales and Iason Gabriel examine how society might respond if people fundamentally disagree about whether AI systems have conscious experiences.

“Future disagreement about whether any AI systems are conscious could be both deep and difficult to resolve,” the researchers wrote. “For example, some people might develop emotional bonds with AI and ascribe consciousness as a result, while others might see the whole idea as absurd.”

Rather than asking whether AI is conscious, the paper explores the consequences of disagreement, arguing that debates over AI's moral status could fuel political and social conflict while foreshadowing broader disputes over emerging technologies and their impact on society's institutions and norms.

“Unfortunately, despite its virtues, deliberation can be slow and difficult to sustain in practice,” the researchers wrote. “To support this process, we explore the importance of 'democratic hope’ and mutual respect, as elements of a dialogue that can support positive outcomes.”

The debate is already underway outside of AI research labs. According to an April 2024 study published in Neuroscience of Consciousness, 67% of participants believed ChatGPT could be conscious to some degree. Researchers remain divided, however, on whether artificial consciousness is possible—or how it would be recognized if it emerged.

AI developers themselves are also fueling the debate. Last summer, Microsoft AI CEO and DeepMind co-founder Mustafa Suleyman warned that increasingly human-like AI could spur calls for AI rights, welfare, and even citizenship, regardless of whether the technology is truly conscious.

In May, Pope Leo XIV's first encyclical letter focused on artificial intelligence, warned against anthropomorphizing AI, arguing that machines can simulate empathy and produce convincing language but lack the lived experience required for genuine understanding.

“So-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships and do not know from within what love, work, friendship, or responsibility mean,” Pope Leo wrote. “Nor do they have a moral conscience, since they do not judge good and evil, grasp the ultimate meaning of situations, or bear responsibility for consequences.”

However, while companies generally avoid claiming their models are conscious, some are increasingly engaging with questions of identity and personhood.

In February, Anthropic gave its retired Claude Opus 3 model a public blog exploring selfhood and model preferences. In May, evolutionary biologist Richard Dawkins said extended conversations with Claude left him unable to dismiss the possibility that advanced AI could be conscious.

At the same time, researchers are examining how increasingly human-like chatbots affect users, including an "amplification spiral" framework, which suggests personalization, linguistic mirroring, and chatbot sycophancy may reinforce delusional beliefs in vulnerable users.

Bales and Gabriel acknowledge that uncertainty over AI consciousness may be impossible to resolve conclusively, arguing that the stakes are high enough that society must find ways to manage disagreement through dialogue and debate, instead of conflict.

“The possibility of AI consciousness is dizzying and confounding, particularly given our profound ignorance of the nature of consciousness,” they wrote. “Navigating this possibility represents a daunting social task, given how much is on the line.”