The legal landscape for Elon Musk’s artificial intelligence venture, xAI, is becoming increasingly turbulent. Baltimore has emerged as the first major U.S. city to launch legal action against the company, specifically targeting concerns surrounding its Grok image generator and its role in the proliferation of deepfake content.
Mayor Brandon Scott of Baltimore articulated the city’s stance in a statement, emphasizing the profound and lasting harm inflicted by deepfakes on victims. “We’re talking about tech companies enabling the sexual exploitation of children,” Scott stated. “Our city will not stand by and allow this to continue; it’s a threat to privacy, dignity, and public safety, and those responsible must be held accountable.”
Following its recent merger with SpaceX, xAI is now navigating a complex web of regulatory scrutiny across multiple jurisdictions. The Grok platform has come under fire for its alleged facilitation of the mass creation of non-consensual intimate imagery, or NCII, including explicit content featuring women and children. This controversy has escalated with a proposed class-action lawsuit filed by attorneys representing three teenagers in Tennessee. The suit alleges that Grok generated sexually explicit and degrading content depicting the minors.
The latest legal salvo, filed in a circuit court on March 24, sees the Mayor and City Council of Baltimore accusing xAI of violating the city’s consumer protection laws. The complaint further alleges deceptive and unfair trade practices, particularly in the marketing of Grok and its associated platform, X (formerly Twitter), as generally safe for users.
A specific point of contention highlighted in the Baltimore lawsuit is a “put her in a bikini” trend that reportedly encouraged Grok users to alter images of individuals, effectively “nudifying” them. Notably, Elon Musk himself is said to have participated in this trend, sharing an AI-generated image via Grok that depicted him in a string bikini.
The complaint argues that Musk’s post served as a public endorsement of Grok’s capability to produce sexualized or revealing alterations of real individuals, thereby signaling to users that such uses were acceptable and even encouraged. The lawyers contend that coming from the owner and prominent public figure of both xAI and X, Musk’s action functioned as direct marketing and promotion for the very image-editing functionality being exploited to create non-consensual sexual imagery.
Baltimore is seeking maximum statutory penalties but has not specified a monetary amount in its filing. Additionally, the city is pursuing injunctive relief, aiming to compel Musk’s company to implement changes to both X and Grok. These reforms would be intended to significantly curb the creation of NCII and child sexual abuse material (CSAM). The city’s demands include ordering X and xAI to cease targeting and exploiting Baltimore residents, reform their platform designs, and revise their marketing strategies.
As of this report, executives at SpaceX and xAI had not immediately responded to requests for comment.
The issue of AI-generated sexual abuse imagery remains a critical concern. A report released by the U.K.-based Internet Watch Foundation highlights that girls continue to be disproportionately targeted by CSAM. In 2025, the organization’s assessment of illegal AI-generated sexualized images revealed that girls were the subjects of 97% of such content. This underscores the urgent need for robust safeguards and accountability within the rapidly evolving AI landscape.
The integration of advanced AI tools like Grok presents both immense potential and significant ethical challenges. While the technology offers innovative creative capabilities, its misuse, particularly in generating harmful and exploitative content, necessitates stringent oversight and proactive measures from both developers and regulatory bodies. The ongoing legal battles highlight the critical juncture at which the AI industry stands, balancing innovation with the imperative to protect individuals and uphold fundamental rights. The outcomes of these lawsuits will likely set important precedents for the future development and regulation of generative AI technologies.
Original article, Author: Tobias. If you wish to reprint this article, please indicate the source:https://aicnbc.com/20065.html
