OpenAI disrupts AI model extraction campaign linked to Moonshot AI
Quick Look
OpenAI identified and disrupted a coordinated campaign to extract protected reasoning from its AI models, linking a core cluster of activity to Chinese startup Moonshot AI, developer of Kimi, involving over 15,000 users and peaking at 16,000 requests in two days, raising concerns about adversarial distillation and national security risks.
AI-generated summary
Why It Matters
OpenAI reported disrupting a campaign to extract protected reasoning from its AI models, following similar accusations by Anthropic against Chinese AI developers weeks earlier.
OpenAI said it identified and disrupted a coordinated campaign in which operators attempted to extract protected reasoning from its artificial intelligence models, linking a core cluster of the activity with Chinese startup Moonshot AI, the developer of Kimi.
The activity began in early July and later surged to 16,000 requests from more than 4,000 users over two days, OpenAI said. The company ultimately identified related activity across a cluster of more than 15,000 users and said it had fully disrupted the campaign by July 28.
The findings come just weeks after OpenAI rival Anthropic accused several Chinese AI developers, including Moonshot AI and Alibaba, of secretly using its Claude model to help train their own AI systems, underscoring growing concerns among U.S. AI companies that rivals could use their models to develop competing technology more quickly and cheaply.
OpenAI described the latest activity as "adversarial distillation," where one AI model's outputs or reasoning are used to help train or improve another model. The company said extracting such reasoning could allow others to reproduce advanced capabilities without making the same investment in developing and safeguarding frontier models, posing potential safety and national security risks.
The operators did not breach OpenAI's encryption, databases or stored user conversations, according to the company. Instead, they manipulated interactions with its models in an effort to reproduce hidden reasoning in a form visible to the requester.
OpenAI said it was unclear whether all the operators involved were linked to a single actor, but attributed a core cluster of the activity to individuals associated with Moonshot AI. The company said it has shared its findings with other AI developers through the Frontier Model Forum as well as government information-sharing channels.
Moonshot did not immediately respond to CNBC's requests for comment.
What to Watch
AI outlook — possibilities, not facts
OpenAI will implement stronger technical safeguards to prevent adversarial distillation attempts
Likely · Within weeks
U.S. government scrutiny of AI model security practices will increase
Likely · Within months
Open Questions
- Whether all operators were linked to a single actor
- What specific safeguards OpenAI will implement to prevent future extraction attempts
- How the Frontier Model Forum will coordinate responses to such threats
