BLACK mobile logo

california

community

Newsom Orders Oversight of AI Companies; Sen. Weber Pierson’s AI Health Care Bias Bill Awaits His Action

September 21, 2026

California Governor Gavin Newsom issued an executive order on September 18 to accelerate the state's independent oversight of artificial intelligence companies, citing inadequate federal regulation and resistance to state-level enforcement. The order mandates development of emergency shutdown capabilities for advanced AI systems, expedites independent safety reviews, and requires a panel of international AI safety experts to deliver a comprehensive regulatory framework by mid-November. This action is part of California's larger legislative push to regulate AI across multiple sectors, particularly in healthcare where algorithms trained on biased historical data could perpetuate existing disparities in patient care.

Who is affected

  • AI companies and developers operating in California
  • Healthcare facilities and providers using AI tools for clinical decisions
  • Patients receiving care influenced by AI algorithms, particularly those from historically marginalized communities including Black patients, women, and other protected classes
  • Gov. Gavin Newsom and California State Government
  • Sen. Akilah Weber Pierson (D-San Diego) and the California Legislative Black Caucus
  • Global AI safety experts forming the newly established advisory group
  • Sen. Jerry McNerney (D-Pleasanton) and Assemblymember Rebecca Bauer-Kahan (D-Orinda)

What action is being taken

  • California is developing an emergency shutdown mechanism ("kill switch") for advanced frontier AI models
  • The state is expediting independent safety audits of AI systems
  • A newly formed group of global AI safety experts is preparing a formal legal and technical roadmap (due November 16)
  • AI developers and deployers would be required (under pending SB 503) to identify, monitor, and guard against unfair bias in medical algorithms
  • The state is establishing a network of trusted AI evaluators through SB 813
  • Third-party auditing requirements and transparency standards are being implemented through AB 1405

Why it matters

  • This matters because AI systems are rapidly expanding into high-stakes areas like healthcare where algorithmic decisions directly impact patient outcomes and can perpetuate or amplify existing disparities. AI tools trained on historically biased medical data risk reproducing discriminatory assumptions, such as the false belief that Black people naturally have lower lung capacity, which could lead to inferior care for marginalized populations. California's regulatory framework is significant because the federal government has resisted comprehensive AI regulation and has attempted to prevent states from enforcing their own rules, making California's action a potential model for other jurisdictions. The healthcare focus is particularly critical since commercial algorithms often inherit systemic biases from existing data, potentially affecting clinical decision-making and resource allocation in ways that worsen health inequities across race, gender, and socioeconomic status.

What's next

  • A formal legal and technical roadmap for AI safety must be submitted by the global AI safety expert group by November 16
  • Gov. Newsom must decide whether to sign Senate Bill 503, which passed the Assembly (70-1) on August 24 and the Senate (39-0) on August 25
  • Ongoing monitoring of AI tools in healthcare settings would be required if SB 503 is signed into law
  • California will continue developing and implementing the emergency shutdown mechanism for advanced AI models

Read full article from source: The San Diego Voice & Viewpoint