California Gov. Gavin Newsom issues executive order to strengthen AI safety oversight
California Governor Gavin Newsom signed an executive order on Friday that tasks a panel of experts with drafting a guide for the state’s AI safety and security laws within two months. The order may require independent third parties to write safety plans for frontier AI companies and could mandate a "kill switch" that shuts down models in emergencies, according to the governor’s office.
Key points
- Gov. Gavin Newsom signed an executive order mandating experts to draft AI safety guidelines within two months.
- The order may require third‑party safety plans and a “kill switch” for frontier AI models.
- Newsom criticized federal inaction, noting President Trump’s dismissal of AI risks and Democratic calls for stricter regulation.
Newsom framed the move as a response to what he called the federal government’s failure to create meaningful AI oversight, noting President Donald Trump’s dismissal of AI safety concerns as a "hoax." He highlighted recent calls from Democratic presidential hopefuls and a former Anthropic researcher’s warning about humanity‑ending AI capabilities, while other officials such as Pennsylvania Gov. Josh Shapiro and Senators Mark Kelly and Cory Booker have also urged stricter regulation.
The governor, whose term ends on Jan. 4, said California is building on the strongest AI regulatory framework in the nation and aims to set a national baseline as Congress appears unlikely to act before the 2026 midterm elections.
California Gov. Newsom issues executive order to rein in AI 'before it's too late'
CNBC Technology · 18 September 2026
California Gov. Gavin Newsom on Friday issued an executive order aimed at addressing the potential dangers related to artificial intelligence.
Newsom is part of a group of 2028 Democratic presidential hopefuls who have urged a more aggressive regulatory approach to the rapidly evolving technology, after a researcher at Anthropic resigned and warned of AI's potentially humanity-ending capabilities in a social media post earlier this month.
The post set off a frenzy in Washington, D.C., as lawmakers grapple with how to establish guardrails for AI. But Congress appears unlikely to take any meaningful legislative action on AI fears before the 2026 midterm elections, and President Donald Trump has so far resisted calls for regulation.
“The federal government’s abject failure to create any form of meaningful AI oversight or accountability should alarm every American, especially when AI CEOs themselves are begging for regulation," Newsom said in a statement on Friday.
“We're not waiting to act – we’re going to speed up our work on substantial and responsible AI oversight before it's too late. We’re going to do this thoughtfully but with urgent velocity; the stakes are too high to wait or delay action," Newsom continued.
The order calls on a group of experts to meet and create, within two months, a guide for the state to strengthen its AI safety and security laws. Those enhanced laws may include a requirement for independent third parties to write safety plans for frontier AI companies, or mandating that companies develop a "kill switch" to shut down their models in case of emergency, according to an announcement from Newsom's office.
While Trump has called fears of AI safety a "hoax," Democrats have largely rallied around calls for stricter regulations. And those with presidential ambitions have been among the loudest voices in recent weeks.
Pennsylvania Gov. Josh Shapiro has similarly called for "third-party" oversight of frontier models and stricter guardrails. Sen. Mark Kelly, D-Ariz., told Politico he's introducing legislation to crate a fund paid for by AI companies that would support workers displaced by the technology. And Sen. Cory Booker, D-N.J., urged Trump to convene a special session of Congress to address AI risks.
Newsom, whose term as California governor ends on Jan. 4, has not announced a presidential campaign, though he has said he is mulling the possibility.
In his announcement of the executive order, Newsom touted laws already in effect in the state, including one he signed earlier this month that creates a framework for third-party AI auditors.
"While Washington abdicates its responsibility to protect Americans, California is building on the strongest AI regulatory framework in the nation," Newsom said. "California has already built a national model, and our policy should be the national baseline."
This text was published by CNBC Technology and written by Justin Papp. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us.
More in Policy & Regulation
All →- Security breach reportedly exposes OpenAI vulnerabilities via Anthropic's Claude AI · 16 src
- Media companies seek billions from OpenAI and Microsoft over copyright infringement · 1 src
- US House passes bill forcing data centers to pay full grid upgrade costs · 2 src
- OpenAI reports six new AI misalignment incidents and unveils reporting framework · 36 src
- Google reportedly helped draft state chatbot laws with loopholes · 2 src
Comments
via GitHub Discussions