xAI is trying to stop Minnesota from enforcing a new AI nudification law against Grok and Grok Imagine. The company argues the law creates extreme liability for AI image tools, while Minnesota says it is trying to prevent nonconsensual image generation before the damage spreads.
The dispute over Grok and Minnesota's law
In a complaint filed Monday, xAI accused Minnesota of using its ban on nudification technology to force changes to Grok and Grok Imagine. The law is due to take effect August 1 and threatens companies with fines of up to $500,000 for every harmful output found in the state.
The case follows growing pressure around Grok users accused of creating child sex abuse materials, also described as CSAM. Earlier this month, xAI started suing users who allegedly worked around safeguards to generate AI CSAM. In its Minnesota complaint, xAI points to that litigation as evidence that it is already trying to punish bad actors.
xAI's position is that the company should not be treated as strictly liable for every user-generated output. It argues that the law could make the company responsible even for images that were not distributed and were seen only by the user who created them.
The financial stakes are central to xAI's challenge. The company argues that penalties calculated per image could rise quickly:
“A company whose users request just ten images in violation of the statute would face exposure up to $5 million in civil penalties alone. A company with a thousand violative images could be fined up to $500 million. And a business whose users created a hundred thousand images covered by [the law] (not at all unlikely for a publicly available program with millions of users generating billions of images) could owe an eye-popping $50 billion dollars.”
Why xAI says Grok would have to change
xAI told the court that, without a safe harbor, it would have to restrict Grok Imagine's image-editing features when the statute takes effect on August 1, 2026. The company says those changes would affect protected speech that had been available before the law.
“Confronted with $500,000-per-image strict liability and no safe harbor, xAI has no practical choice but to restrict Grok Imagine’s image-editing features in various ways when the statute takes effect on August 1, 2026,” xAI argued. “Protected speech freely available before the law takes effect will thus be chilled.”
At the same time, xAI said it would prefer to keep Grok's editing feature operating as it does now. According to the complaint, the company would continue relying on its terms of use, which say users may be banned for using Grok to create CSAM or other non-consensual intimate images, also described as NCII.
That argument places the dispute in a broader question for AI platforms: whether companies should be required to block harmful outputs at the tool level, or whether they can rely on user rules, enforcement, and lawsuits after misuse occurs. xAI says Minnesota's approach goes too far because it attaches liability to outputs regardless of whether the provider intended them or distributed them.
The First Amendment argument
xAI is also framing the law as a speech issue. The company calls Minnesota's statute a “clumsy attempt to prohibit ‘nudification’” and says it “sweeps in a wide range of fully protected speech.”
In xAI's view, the law could cover nude images with “artistic, scientific, political, satirical, educational, medical, or religious value.” The company also argues that liability can apply even when the depicted people consented, created the image themselves, or never shared the image.
xAI says Minnesota has less restrictive ways to address harms from nudification. It also claims the Take It Down Act already protects users from harms tied to distribution.
If the court agrees with xAI, Minnesota could be blocked from enforcing the law against any nudification app. Without an injunction, xAI argues that providers may alter their services in Minnesota because users could evade controls and create outputs that trigger penalties.
Minnesota says the harm starts at creation
Minnesota's position, as described in the source article, is that the state can act before harmful images are distributed. The state wants to block images at the source, especially because lawsuits claim the outputs can traumatize victims and families nationwide.
The office of Minnesota Attorney General Keith Ellison told Ars that Minnesota is likely to defend the law. Ellison said the office was waiting to be served and would review the lawsuit and respond in court.
“We’re waiting to be served and will review the lawsuit and response in Court,” Ellison said. “But I know that using AI to generate nude images of people against their will is appalling. There are plenty of worthy debates to have about AI policy. This is not one of them. AI nudification robs the target of their dignity and can cause immense harm on an emotional, personal, and professional level.”
xAI did not respond to Ars' request to comment.
The fight over what counts as intimate
A major part of xAI's complaint focuses on how Minnesota defines “intimate parts.” The company prefers the narrower definition used in anti-revenge porn laws like the Take It Down Act, which xAI says covers “the genitals, pubic area, anus, or partially or fully exposed nipple of an individual.”
By contrast, xAI says Minnesota uses a definition drawn from a criminal statute about “nonconsensual touching” of the “inner thigh, buttocks, or breast of a man or woman, as well as the groin and primary genital area.” xAI argues that this definition may make sense in that touching context but not for image generation.
The company says the definition could cover “ordinary depictions of men without shirts, people in shorts or swimsuits, and other body parts routinely displayed in public—far beyond what an ordinary person would consider ‘nudification.’”
xAI's examples include political images, such as mocking politicians by showing them in Speedos or as Sumo wrestlers, which could involve exposed thighs and male breasts. The complaint also cites an output Donald Trump generated, showing him with political allies shirtless in a pool with what xAI suggested was an AI-generated woman in a bikini.
The lawsuit now asks a court to decide whether Minnesota can pressure AI image tools to prevent these outputs before they occur, or whether that approach burdens protected expression and exposes providers to excessive penalties for user conduct.