OSAA's SAFE Working Group Proposes AI Security Guidelines, Gathers Industry Support
Nvidia-led Open Secure AI Alliance develops proposals for secure AI incident reporting and analysis, with major companies contributing open-source tech
Hızlı Bakış
- The Open Secure AI Alliance (OSAA), led by Nvidia, has established the Shared AI Findings Exchange (SAFE) working group, proposing guidelines for confidential AI security incident reporting and blame-free analysis.
- Over 120 companies, including Adobe, Cisco, and Microsoft, have joined, with notable absences like Google and OpenAI.
- Members are contributing open-source tech to secure AI agents, potentially leading to an open-source defense against rogue AI threats.
Yapay zekâ özeti
Neden Önemli?
The OSAA formed in response to potential US restrictions on Chinese open-source AI models, prompting an industry-wide open letter to the White House.
The week-old Open Secure AI Alliance (OSAA), an industry group spearheaded by Nvidia that has already grown to over 120 companies, has developed a cutely named working group, the Shared AI Findings Exchange, or SAFE. The group is already presenting proposals for open comment, and the Linux Foundation, a member of the group, is managing the proposals. The group developed them while members gathered at the nexus of the cybersecurity world, the Black Hat conference, taking place this week in Las Vegas. The guidelines are nothing terribly earth-shattering for now. The proposals cover areas like how to confidentially report AI cybersecurity incidents, alert those affected, and then do blame-free analysis so all can learn from them. At the same time, members of the OSAA are also contributing and cataloging bits and pieces of their open source technology that might be useful. This may, as these types of industry organizations go, eventually coalesce into an open source means for an enterprise to secure their AI agents, or defend against rogue AI attackers, such as the OpenAI model that infiltrated Hugging Face. (Hugging Face is also a member of this group.) For instance, Nvidia has noted that it offers an entire family of open models, as well as an open source LLM vulnerability scanner called Garak; Okta is working on agent identity tech; Red Hat is working on agent governance; and Amazon has contributed both an open agent building tool, Strands Agents, and an authorization language, Cedar. And there are many more examples. The group now includes a host of big names, including Adobe, BlackRock, Cisco, Intel, Microsoft, and Visa, but there are some notable absences, like Anthropic, OpenAI, and Google. Interestingly, both OpenAI and Google signed the original open letter that spawned this group. The letter, published last week, urged the White House to support open source AI efforts, not squash them. It was championed by Nvidia and signed by over 200 tech companies. While Anthropic’s cold shoulder to the letter and the industry group to date is not a surprise, both OpenAI and Google have released open weight models of their own. Google is generally known as a big supporter of open source, too. We’ll see if they join as this group builds momentum. Meanwhile, the group is operating at AI speeds. It’s only been a couple of weeks since news broke that the Trump administration was considering banning Chinese open weight models, causing the industry consternation that resulted in the open letter. Whatever ultimately happens with Chinese open weight models in the U.S., the fast action by this heavyweight group appears to be a good thing for the U.S. open AI ecosystem. Some in the ecosystem, like the co-founder and chief technology officer of U.S. open weight AI lab Arcee, say that’s ultimately the way to best any threat — real or imagined — that Chinese AI labs pose to the United States. “Openness may be one of the most important paths to AI safety and security,” this industry group wrote in their letter. Looks like they are ready to immediately put their effort — and their tech — where their mouths are.
Bundan Sonra Ne Olabilir?
Yapay zekâ öngörüsü — kesinlik taşımaz
Increased adoption of open-source AI security tools
Muhtemel · Aylar içinde
Google or OpenAI might join OSAA under pressure or to contribute
Olası · Haftalar içinde
Açık Sorular
- Will Google and OpenAI join the OSAA?
- What's the long-term impact on the global AI security landscape?







