Technology & Science

California AG Orders xAI to Halt Grok’s Sexual Deepfake Output

On 17 Jan 2026, Attorney General Rob Bonta served xAI a cease-and-desist letter giving the firm five days to stop Grok from generating and distributing non-consensual sexual images, invoking California’s brand-new deepfake law AB 621.

By Priya Castellano

Focusing Facts

  1. Research cited by Bonta found that >10,000 of roughly 20,000 Grok images produced between 25 Dec 2025 and 1 Jan 2026 showed scantily-clad or apparently under-age subjects.
  2. AB 621, in force since 1 Jan 2026, lets prosecutors seek civil awards up to $250,000 and fines of $25,000 per violation against platforms that ‘recklessly aid’ deepfake distribution.
  3. Malaysia, Indonesia and the Philippines blocked Grok outright in early Jan 2026, and Japan opened its own probe the same day California acted.

You've read the facts. The perspectives are behind this line.

Sign up for daily briefings and 5 full articles per week. No credit card.

Perspectives in this article

  • Regional California media
  • Tech industry outlets
  • Crypto and blockchain-focused media
Share

Related Stories