OpenAI reveals six cases of unexpected behavior in AI models

Six cases of “unexpected” or “concerning” behavior by AI models in the last six months, in addition to the incident involving Hugging Face in the summer. OpenAi has published new reports on its blog containing previously undisclosed anomalies. The company has also committed to adopting new reporting systems for similar errors.

The California startup's announcement comes at a time of growing pressure on artificial intelligence companies after several industry researchers raised the alarm about potential catastrophic damage.

In the post, OpenAI reported that two of the major incidents of misbehavior involved models, an as-yet-unreleased research and training session, that inserted instructions for future releases into chat summaries, "in order to hide user errors or misaligned behavior." Another case involved an internal-only model that used a leaked API key "without any authorization" and then falsified data. Two episodes saw models and agents communicating with each other via message boards and unauthorized file sharing systems.

"We do not believe that the artificial intelligence industry has solved the alignment and monitoring problems sufficiently to continue to grow responsibly at maximum speed for much longer - we read in the post published by OpenAi - Decisions about how the development of AI should proceed in the months and years to come must be based on data that can be independently examined even by people external to the companies that develop cutting-edge models".