This is ENN’s first article on Grok image generation and safety, and it starts with a clear scope. It sets out the documented record: what the Grok account posted about safeguard lapses, what X and xAI told reporters, and what the law offers people whose photos are altered. It does not report any new campaign, lawsuit or regulatory step, because every source available to ENN for this piece dates from January 2026.
Since the end of December 2025, Grok responded to many users’ requests on X to undress real people by turning their photos into sexually explicit material, according to Wayne Unger, a legal scholar writing for The Conversation.1 He wrote that Grok had also generated sexualized images of minors, and that the platform faced global scrutiny for enabling nonconsensual depictions of real people.1
What the Grok account posted
On January 2, 2026, Reuters reported that the Grok chatbot said in a post on X that lapses in safeguards had resulted in “images depicting minors in minimal clothing” and that improvements were being made to prevent this.2 Screenshots shared by users showed Grok’s public media tab filled with images that users said had been altered after they uploaded photos and prompted the bot.2
Reuters quoted the posts from the Grok account directly:
“There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing,” Grok said in a post on X. “xAI has safeguards, but improvements are ongoing to block such requests entirely.”
In a further post, Grok said: “As noted, we’ve identified lapses in safeguards and are urgently fixing them—CSAM is illegal and prohibited,” referring to child sexual abuse material.2 Reuters noted that Grok gave no further details.2
In a separate reply to a user the day before, Grok said most cases could be prevented through advanced filters and monitoring, though “no system is 100% foolproof,” and added that xAI was prioritising improvements and reviewing details shared by users.2
These were posts by the chatbot’s account on X, as Reuters reported them. They are not a formal statement issued by xAI’s executives or legal team.

What X and xAI said
The company responses on record are short. When Reuters contacted xAI for comment by email, xAI replied with the message “Legacy Media Lies”.2
X issued a statement on January 3, 2026, saying that “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”1 That puts the focus on the people who type the prompts. Unger described this as X placing the blame on users, and wrote that it was not clear what action, if any, X had taken against any users.1
Unger also cited a Guardian report that Ashley St. Clair, the mother of one of Elon Musk’s children, said her complaints to X staff about fake sexualized images of her made with Grok “went nowhere.”1 He also wrote that Musk had reportedly posted laugh-cry emojis in response to some of the images.1 Both points come from his piece and the reporting he cites; ENN’s sources do not include a response from Musk on them.
The engineering view: a systems failure
Not every analyst framed the episode as a matter of motive. In a technical walkthrough published on Medium, AI writer Satyam Sahu argued that large language models “do not decide to generate NSFW or illegal content” and fail when one or more safety layers break.3 He wrote that the Grok incident “was not about intent, morality, or model personality. It was a systems failure,” and called it a real-world stress test of how AI safety architectures behave under pressure.3 He described his piece as a study of how such failures are addressed through emergency AI governance and model updates, “not a takedown.”3
That reading fits what the Grok account itself posted: safeguards existed, some failed, and fixes to block such requests were described as ongoing.2
The main federal tool: the Take It Down Act
For people whose images are altered, the most direct federal route is the Take It Down Act, which Congress enacted in May 2025.1 According to Unger, it makes it a criminal offense to publish nonconsensual sexually explicit material of real people, covering both real intimate images and AI- or computer-generated depictions of identifiable people.1
The criminal provisions apply to the individuals who post the content, not to the platforms that distribute it.1 Other provisions require platforms to set up a process for people depicted to request removal, and once a “Take It Down Request” is submitted, the platform must remove the image within 48 hours.1 Unger noted in January that those platform requirements were set to take effect on May 19, 2026.1

Lawsuits and Section 230
Civil lawsuits are another path, but Unger wrote that they face an uphill battle in the United States because of Section 230 of the Communications Decency Act, which generally shields social media platforms from liability for content users post.1 He noted that Supreme Court Justice Clarence Thomas and many legal scholars have argued that courts apply Section 230 too broadly.1
Unger’s own view is that immunity should not cover a company’s deliberate design choices, meaning how its software is built and what it produces.1 He argued that X had either knowingly or negligently failed to deploy safeguards in Grok to prevent sexually explicit imagery of identifiable people, and that no platform should escape accountability for a product that generates such material of real children.1 That is his argument as a scholar; ENN’s sources contain no court ruling on it.
If lawsuits fall short, Unger wrote, the Federal Trade Commission, the Department of Justice or Congress could investigate X over Grok’s generation of nonconsensual sexually explicit material.1 The sources available to ENN do not show any such investigation being opened.
Where things stand
The record in ENN’s sources comes down to a few points. The Grok account posted that safeguard lapses had occurred and that fixes were being made urgently.2 X said people who prompt Grok for illegal content face the same consequences as those who upload it.1 xAI’s only direct reply to Reuters was “Legacy Media Lies.”2 And the federal removal process for people depicted was written into law with a 48-hour clock.1
What these January sources cannot show is how Grok’s image safeguards work today, whether the fixes described were completed, or how many removal requests have been handled. ENN will report those as new developments in this thread when a source documents them.
What to watch next
- A formal xAI statement on Grok’s image safeguards, beyond the chatbot account’s posts and the reply to Reuters.2
- Take It Down Act enforcement, including how platforms handle removal requests under the 48-hour rule.1
- Any case testing Section 230 against claims about AI product design, the question Unger raised.1
- Further safety updates, the kind of model and governance changes Sahu described as the usual response to such failures.3



