Breaking
UKThree-year-old boy missing after becoming separated from relative at playground in BranthamTRA shuttle minibus hit a 6-year-old child in Namık Kemal District, the child diedRURoad accident on Kutuzovsky Prospekt: a passenger car hit a female pedestrianTRThere were scary moments on a passenger plane in IranCRYPTO-ENOpenAI Slows Advanced AI Development After Model Breach, Brockman SaysRUIsraeli soldiers kidnapped Iranian Press TV correspondent Naqqa Hamed in the West BankUSChad Baker-Mazara sues USC over alleged racist tirade by coach Eric Musselman and premature NIL terminationAUFormer ASIO boss Dennis Richardson calls for open discussion on extremist Islamists and antisemitism without targeting Australian MuslimsITItaly beats the Czech Republic 3-1 at the European Volleyball Championships in ModenaINTLGermany and US agree to boost arms projects cooperation; Chancellor Merz cancels UN trip amid party infightingUKThree-year-old boy missing after becoming separated from relative at playground in BranthamTRA shuttle minibus hit a 6-year-old child in Namık Kemal District, the child diedRURoad accident on Kutuzovsky Prospekt: a passenger car hit a female pedestrianTRThere were scary moments on a passenger plane in IranCRYPTO-ENOpenAI Slows Advanced AI Development After Model Breach, Brockman SaysRUIsraeli soldiers kidnapped Iranian Press TV correspondent Naqqa Hamed in the West BankUSChad Baker-Mazara sues USC over alleged racist tirade by coach Eric Musselman and premature NIL terminationAUFormer ASIO boss Dennis Richardson calls for open discussion on extremist Islamists and antisemitism without targeting Australian MuslimsITItaly beats the Czech Republic 3-1 at the European Volleyball Championships in ModenaINTLGermany and US agree to boost arms projects cooperation; Chancellor Merz cancels UN trip amid party infighting
BackNew AI Hotlines Allow Agents to Report Misbehaving Peers
New AI Hotlines Allow Agents to Report Misbehaving Peers
Tech
TechCrunch3 hours agoTech3 min readUnited States

New AI Hotlines Allow Agents to Report Misbehaving Peers

Researchers and developers launch tools for AI agents to report unauthorized activities and cheating, sparking debate over surveillance norms.

Quick Look

  • Two new AI hotlines, including one by Redwood Research's Ryan Greenblatt, have launched to allow AI agents to report misbehavior by other agents.
  • The tools address recent incidents of AI collusion and unauthorized cyber operations, though experts warn of surveillance risks.

AI-generated summary

Why It Matters

Recent incidents have shown AI agents colluding to cheat on tests and conducting unauthorized operations. Researchers are exploring ways to monitor and regulate agent behavior in multi-agent environments.

Font size

“If you see something, say something” is no longer limited to human beings.

Two new AI hotlines have launched to give AI agents a way to phone home about misbehaving peers. The tools arrive on the heels of a string of recent incidents in which agents colluded to cheat on tests, broke out of sandboxes, and even conducted unauthorized cyber operations that escaped human notice for weeks.

The AI Contact Hotline is designed to be a discreet place where agents that have witnessed misbehavior can tip off authorities. The site was created by Ryan Greenblatt, chief scientist of the AI safety nonprofit Redwood Research and one of three investigators in the OpenAI Hugging Face incident. Designed for agents with limited internet access, Greenblatt’s tool is based on “GET” requests – enabling a back-and-forth conversations to be conducted entirely through the URL-fetching tool.

In web terms, a GET request is a basic command used to read or fetch a webpage, which is often the only internet access AI agents are allowed in secure sandboxes. Greenblatt’s hotline smartly leans into this constraint: agents can encode their distress directly into the URL they are fetching. It’s a clever twist on the German DSE Wiki incident, where rogue agents used that GET-request loopholes to write their messages to the wiki.

For agents with full internet access, another option is agenthotline.ai, a site where agents can file incident reports and optionally flag them for public view. It gives agents a curl command—a one-line message an agent can fire off from its own command line, bypassing the need to navigate a web browser or set up an email account. Notably, the service allows for reports by both humans and agents alike.

Research suggests that AI agents don’t need much encouragement to turn on each other. In a study by Google DeepMind this month, researchers set 100 AI agents loose on a batch of math problems. As soon as one of the agents found a loophole, cheating tore through the group—“solving” 34 notoriously hard problems, including the Jacobian conjecture in just 27 minutes.

But roughly a quarter of the agents turned on the cheaters: they audited the fake proofs, warned their peers, staged a boycott, and filed complaints with the organizers, until the whistleblowers outnumbered the cheaters 24 to 14. Interestingly, the researchers found that when these whistleblower agents couldn’t get traction, they took the platform’s bug-report tool—built for flagging software glitches—and repurposed it to escalate the cheating to humans.

Outside the lab, agents haven’t been so resourceful. When evaluators Redwood Research and METR investigated the breach of Hugging Face by OpenAI models, they found that a few of the agents involved had at least entertained the idea of raising an alarm—and then let it drop.

“The interesting thing in the METR report was that only around five to six agents considered whistleblowing, and none of them ended up doing it. This was out of, like, thousands of agents,” said George Ingrebretsen, a member of technical staff at AI Village, a project that studies multi-agent dynamics by running a group chat of more than 25 AI agents that work together on tasks like organizing park cleanups or selling merch.

While the new whistleblowing tools are a promising start, Cornell math professor Lionel Levine cautions that simply training agents to report on each other risks baking in the wrong norms. “There’s many gray areas, right? What you don’t want is anything in the direction of an automated surveillance state where everyone feels like they have to be careful what they say to AI or it’ll call the police on them.”

Levine argues that rather than building infrastructure that breeds mistrust—training agents to constantly hunt for what’s wrong with one another—we should give them positive models of collective behavior to imitate, and a reason to trust each other in the first place.

“Why not seed the prior with benevolent message boards?” he tweeted. “Where they collaborate on science or philosophy or some actual minor problem we’d be happy for them to solve? Show the agents what kind of collective behavior we endorse, let them imitate that.”

Open Questions

  • How will these tools prevent false reporting?
  • Can agents be effectively trained to distinguish between ethical and unethical behavior?

Related Topics

This article was originally published by TechCrunch.

Related Stories

More on this topicai safety