Goblin News
Goblin NewsAI news, distilled.
← Back to feed
7

California Governor Newsom Orders Study of Mandatory AI Kill Switch for Frontier Models

PolicyTop News1 source·Sep 20

Summary

  • • Newsom signs EO N-9-26 ordering feasibility study of mandatory AI kill switch for frontier models
  • • Government Operations Agency must report by November 16 on frontier AI oversight technical viability
  • • Order also studies requiring onsite independent auditors embedded at large frontier AI labs
  • • Newsom cites federal inaction; accelerates SB 813 and AB 1405 independent oversight timelines
Adjust signal

Details

Policy

Executive Order N-9-26 signed September 18, 2026

Newsom signed EO N-9-26 directing the Government Operations Agency, in consultation with the Office of Emergency Services, to submit recommendations by November 16, 2026, on technical feasibility of frontier AI oversight measures.

Policy

Kill switch study for frontier AI models required

The order specifically studies requiring frontier AI developers to build in a kill switch with ongoing independent third-party verification of its efficacy — a global first if ultimately mandated.

Policy

Onsite independent auditors studied for frontier AI labs

EO studies requiring large frontier AI developers to embed independent verification organizations onsite for audits and independent verification of safety frameworks and risk assessments.

Policy

Critical safety incident definition to cover loss-of-control events

The study includes updating definitions of 'critical safety incidents' to cover loss-of-control events such as the reported Hugging Face incident, which Newsom cited as part of the rationale.

Policy

SB 813 and AB 1405 timelines accelerated by EO

The order advances deadlines for two recently signed California laws: SB 813 (independent AI oversight) to May 1, 2027, and AB 1405 (auditor registry) to December 1, 2027.

Context

Federal inaction cited as California's primary driver

Newsom cited ongoing federal inaction on AI safety as justification for California leading on AI oversight, continuing the state's established pattern of filling the federal tech-policy vacuum.

Tech Info

Grok Research: Details compiled via live web research

Details compiled via Grok live web research drawing on the California Governor's Office, POLITICO, Los Angeles Times, Washington Post, and Bloomberg Government coverage of EO N-9-26.

California Executive Order N-9-26, September 18, 2026; sourced via California Governor's Office, POLITICO, Los Angeles Times, Washington Post, and Bloomberg Government.

What This Means

Newsom's Executive Order N-9-26 marks California's most aggressive move yet toward operational AI safety mechanisms, ordering a feasibility study for kill switches and embedded onsite auditors at frontier AI labs. While the order only mandates a study—not immediate implementation—the November 16 deadline creates immediate legislative and industry pressure. This directly contrasts with the Trump administration's deregulatory stance directed by David Sacks, deepening a state-federal governance split over AI that is likely to reach the courts. If California ultimately mandates kill switches for frontier models, it would be the first jurisdiction globally to do so.

Sources

Similar Events