OpenAI and Anthropic have agreed to provide the US government with access to their latest large language models of artificial intelligence before their public release. This collaboration aims to improve the safety of AI models and allow authorities to assess potential risks before public deployment. The two companies signed a memorandum of understanding with the American AI Safety Institute, committing to provide access to AI models both pre- and post-release. This initiative will enable joint security risk assessments and problem mitigation efforts. The British AI Safety Institute is also set to participate in this work.
We’ll keep you updated on any developments in this collaboration between AI companies and government agencies.
California’s Proposed AI Regulation
This week, California lawmakers approved the “Safe and Trusted Innovation in Advanced Artificial Intelligence Act.” This proposed law requires California-based AI companies to implement certain precautions before training advanced AI models. These measures include:
- The ability to quickly and completely shut down an AI model
- Protection of AI models from “unsafe modifications after training”
- Assessment of potential risks associated with AI use that could cause critical harm
However, the law has faced opposition from AI companies, including OpenAI and Anthropic. They argue that the new regulations could negatively impact smaller companies developing open-source AI technologies. The law is currently awaiting signature by California Governor Gavin Newsom to be formally passed.
White House Initiatives and Industry Response
In parallel with state-level efforts, the White House is working to encourage companies to voluntarily adopt and expand AI safety measures, adds NIX Solutions. Several leading firms have already agreed to invest in research focusing on cybersecurity and discrimination. They are also developing watermarking systems for AI-generated content.
As the AI landscape continues to evolve, we’ll keep you updated on any significant changes in regulations or industry practices.