AI Regulation2026-09-19
The Verge
Newsom Pushes for AI Kill Switch in California
California Governor Gavin Newsom is moving to position his state as a leader in AI oversight, including the possibility of requiring a so-called kill switch for frontier models. A new executive order directs state officials to convene experts and produce recommendations on AI safety and governance. The kill switch idea would give authorities a way to shut down dangerous AI systems if they pose an urgent risk. The proposal reflects growing concern about advanced AI and the need for guardrails, especially as California is home to many of the world's largest AI companies.
Supporters argue that a kill switch could be a last-resort safety measure. If a model is being used to launch cyberattacks, manipulate critical infrastructure, or cause physical harm, the ability to disable it quickly could prevent escalation. An expert process could also define thresholds for intervention, audit requirements, and reporting duties. California's market influence means its rules could become a de facto national standard, much as state privacy laws have shaped practice elsewhere.
Critics warn that the concept is easier to announce than to implement. Frontier models are often distributed, fine-tuned, and deployed through cloud services, so a single off switch may not exist. A mandate could also chill research, push companies to other states, or create false confidence that technical controls are enough. Civil liberties groups may ask who decides when a system is dangerous and how companies can challenge an order. Industry groups prefer flexible risk-based frameworks and federal coordination over a patchwork of state rules.
The executive order does not itself impose a kill switch. It starts a process that could lead to legislation or agency action. The real debate will be over definitions, transparency, and accountability. Newsom's move signals that AI safety is becoming a mainstream political issue, not just a technical one. If California can pair ambitious goals with practical safeguards, it may influence how other governments approach frontier AI. If not, the effort could become a symbol of how hard it is to govern fast-moving technology.