OpenAI is advocating for its AI safety institute (CAISI) to play a larger role in evaluating advanced AI models, as CEO Sam Altman meets with US officials. The company seeks clearer criteria for AI scrutiny and mandatory evaluation processes, while expressing concerns about the NSA's classified benchmarking approach.
Google, Microsoft, and xAI have agreed to provide the US government with early access to their most powerful AI models. This initiative, led by the Department of Commerce's CAISI, aims to assess potential risks like cyber warfare and military misuse before public release. The collaborations will involve testing models with safety features removed to understand their core capabilities under pressure.
Agreements with Microsoft, Google DeepMind and xAI focus largely on recognizing cybersecurity, biosecurity and chemical weapons risksThe US government has struck deals with Google DeepMind, Microsoft and xAI to review early versions of their new AI models before they are released to the public.The Center for AI Standards and Innovation (CAISI), part of the US Department of Commerce, announced the agreements on Tuesday, saying the review process would be key to understanding the capabilities of new and powerful AI models as well as to protecting US national security. These collaborations will help the federal government “scale (its) work in the public interest at a critical moment”, the agency said in a press release. Continue reading...
Microsoft, Google DeepMind and xAI products to be vetted for cybersecurity, biosecurity and chemical weapons risksThe US government has struck deals with Google DeepMind, Microsoft and xAI to review early versions of their new AI models before they are released to the public.The Center for AI Standards and Innovation (CAISI), part of the US Department of Commerce, announced the agreements on Tuesday, saying the review process would be key to understanding the capabilities of new and powerful AI models as well as to protecting US national security. These collaborations will help the federal government “scale (its) work in the public interest at a critical moment”, the agency said in a press release. Continue reading...
Google DeepMind, Microsoft, and Elon Musk's xAI have agreed to allow the US government to review new AI models before they're released to the public. In an announcement on Tuesday, the Commerce Department's Center for AI Standards and Innovation (CAISI) says it will work with the AI companies to perform "pre-deployment evaluations and targeted research […]
NIST's CAISI evaluated DeepSeek V4 Pro using private benchmarks and a cost-comparison filter that excluded every US model except GPT-5.4 mini. Critics call the methodology convenient.
