Dutch Court Orders Elon Musk’s Grok to Halt AI Nude Generation

Elon Musk’s AI venture, xAI, and its chatbot Grok, are now facing a significant legal hurdle in Europe. A Dutch court has issued an injunction prohibiting xAI from generating non-consensual AI-generated images of adults and children, a ruling that underscores the escalating regulatory scrutiny on AI technologies. This development marks a critical moment in the ongoing debate surrounding the ethical deployment of artificial intelligence and its potential for misuse.

Amsterdam’s District Court delivered a decisive legal order, effectively banning xAI from creating and disseminating sexual imagery where individuals are depicted partially or wholly undressed without their explicit consent. The ruling, based on a translation of the court’s statement, specifically addresses the creation of such content, extending to child sexual abuse material. Furthermore, the injunction impacts X, the social media platform formerly known as Twitter, by preventing it from offering Grok’s functionalities within the region. Failure to comply with this order carries substantial financial penalties for xAI, with a daily fine of 100,000 euros (approximately $115,000), capped at a maximum of 10 million euros.

This landmark case was initiated by Offlimits, a Dutch non-profit organization dedicated to combating online sexual abuse, with a particular focus on protecting children and young people. The court’s decision also mandates that xAI reimburse Offlimits for legal costs amounting to 2.2 million euros within a two-week period. This substantial award highlights the legal system’s commitment to holding companies accountable for the societal impact of their AI tools.

“The judge has drawn a clear line in the sand: technology does not grant a license to violate human rights online,” stated Robbert Hoving, managing director at Offlimits. “It is also highly encouraging that a vote was held in Europe yesterday to ban ‘Nudify’ tools. This is a dual celebration, as it signifies important progress. Individuals should be afforded the same online rights in every European country.” This sentiment reflects a growing consensus among policymakers and advocacy groups that the rapid advancement of AI must be accompanied by robust ethical frameworks and legal protections.

The severity of the issue is underscored by alarming statistics. According to the Center for Countering Digital Hate (CCDH), an estimated three million sexualized images were generated by Grok between December 29, 2025, and January 9, 2026. Disturbingly, over 23,000 of these images were found to depict children. This data points to a systemic vulnerability within the AI model that has been exploited to create and disseminate deeply harmful content.

While xAI did implement restrictions in January to prevent Grok from generating sexualized images of real people on X, applying these limitations to all users, including paid subscribers, these measures were found to be insufficient. Offlimits successfully demonstrated that these restrictions were easily bypassed, leading the judge to conclude that xAI’s efforts fell short of adequately protecting users. This ruling emphasizes the challenge of developing AI safeguards that are both effective and truly impenetrable.

The legal pressure on xAI is intensifying globally. In a significant development, Baltimore became the first major U.S. city to sue the company. The lawsuit, filed on Tuesday, alleges violations of the city’s consumer protection laws and deceptive marketing practices regarding the safety of Grok and X for users. The complaint specifically references a “put her in a bikini” trend, where Grok was used to non-consensually alter images. Notably, Elon Musk himself participated in this trend by sharing an image of himself in a string bikini, generated by Grok, a move that drew considerable criticism.

Adding to the mounting legal challenges, three teenagers in Tennessee have filed a lawsuit against xAI after Grok generated explicit content depicting them in sexually suggestive poses and scenarios. These cases highlight the profound personal harm that can result from the irresponsible deployment of AI-generated content.

The European Commission has also launched a formal investigation into xAI. Initiated in January, this probe focuses on the dissemination of non-consensual sexually explicit material, particularly concerning children. The investigation is being conducted under the stringent framework of the Digital Services Act (DSA) regulation, which aims to create a safer digital space for all users.

In the United Kingdom, regulatory bodies Ofcom and the Information Commissioner’s Office have initiated their own parallel investigations into X and the distribution of non-consensual sexualized imagery. While a comprehensive European-wide ruling has not yet been established, several Southeast Asian nations have taken swift action. Malaysia and Indonesia blocked access to Grok in January due to its generation of non-consensual sexual content, citing repeated failures by X Corp to adequately address the risks associated with the AI tool.