Elon Musk’s xAI is trying to sue its way out of a Grok reckoning as arrests of users accused of making child sex abuse materials (CSAM) have triggered lawsuits from kids to sue xAI to force changes to the tool to block harmful outputs.
According to Ars Technica, xAI started suing users who are allegedly circumventing its safeguards to generate AI CSAM, seemingly hopeful that an early court win will guarantee it’s not liable for supposedly user-generated content.
xAI is also suing Minnesota to stop a new law threatening Grok with fines of up to $500,000 for each unlawful AI-generated nude.
The law takes effect on 1 August and prohibits online services from allowing users to “nudify” identifiable people. Victims would gain the right to sue for damages.
Faced with the novel prospect of being held responsible for what its product produces, xAI has reached for the First Amendment.
The company claims Minnesota’s law is too broad because it covers consensual images, unpublished material and pictures with artistic, political, educational or satirical value.
It also objects to Minnesota’s definition of “intimate parts,” which includes breasts, buttocks and inner thighs. xAI says that could cover men without shirts, people in swimsuits and politicians depicted as sumo wrestlers.
There is a serious constitutional argument buried beneath the corporate squirming, since laws restricting speech must normally be narrowly written.
Unfortunately for xAI, its own complaint makes the company sound more interested in preserving Grok’s existing features than protecting expression.
The filing says that without Minnesota’s penalties, xAI would continue offering Grok Imagine’s editing feature exactly as it does today.
xAI says it already bans child sexual abuse material and non-consensual intimate images through its terms of service. It has sued an alleged Grok user and says thousands of accounts have been suspended or reported to law enforcement.
The company argues that firms making good-faith efforts should receive legal protection when users evade safeguards, particularly when penalties can reach hundreds of millions or even billions of dollars.
Minnesota argues that companies should stop abusive images at the source before they are distributed and cause lasting harm. xAI is facing lawsuits from children and families who say Grok was used to sexualise genuine photographs.
A court may decide Minnesota drafted its law too broadly. It may also decide that xAI cannot sell a powerful image generator, rely on contractual warnings and blame users whenever predictable abuse arrives. Either way, Grok can apparently be made safer, but xAI needed a possible $500,000 fine per image before discovering where the controls were kept.
