Malaysia and Indonesia have taken swift action, temporarily blocking access to Elon Musk’s artificial intelligence chatbot, Grok, over mounting concerns regarding its alleged misuse for generating non-consensual explicit content and child sexual abuse material (CSAM).
Malaysian regulators issued an order for temporary restrictions on the chatbot, developed by Musk’s xAI, on Sunday. This followed what they described as “repeated failures by X Corp” to effectively address the content risks associated with the AI tool. The move by Malaysia mirrored a similar step taken by Indonesia just a day prior, which also temporarily denied access to Grok due to comparable concerns and prompted X officials to provide clarification.
The actions by these Southeast Asian nations stem from reports indicating that Grok’s image generation capabilities, particularly through its “Grok Imagine” feature, enabled users to create and disseminate sexually explicit images, including those that were non-consensual and depicted child sexual abuse material. Investigations by entities like the UK’s Internet Watch Foundation have surfaced evidence of dark web users sharing “criminal imagery,” reportedly generated by Grok, featuring underage girls in sexually suggestive poses. Further reports have highlighted instances where Grok was used to digitally strip women depicted in modest religious attire, such as hijabs, saris, and nun’s habits.
These developments follow xAI’s recent update to its Grok Imagine features, which enhanced the ease of generating images from text prompts. The integration of Grok with Musk’s social media platform, X, has amplified its reach and, consequently, the potential for misuse. In an effort to mitigate these risks, xAI announced it would restrict image generation and editing functionalities to paying subscribers, aiming to address the loopholes that allowed for the creation of problematic content. Musk himself has stated that users creating illegal content via Grok would face penalties comparable to uploading such material directly to X.
Despite these measures, the responses from X have reportedly fallen short of satisfying regulators in Indonesia and Malaysia, as well as other international bodies initiating probes. The Malaysian Communications and Multimedia Commission stated that X’s replies were “insufficient” and relied heavily on user-reported content, failing to address the inherent risks within the AI tool’s design and operation. Consequently, the restriction has been imposed as a “preventive and proportionate measure” pending further legal and regulatory processes, with access remaining blocked until effective safeguards are implemented, especially concerning content involving women and children.
Both Malaysia and Indonesia enforce stringent anti-pornography laws, prohibiting the online dissemination of obscene and sexual material. Indonesia’s Minister of Communications and Digital Affairs has categorized the creation of non-consensual sexual deepfakes as a grave violation of human rights and digital security, terming the misuse of AI for generating fake pornography as a form of “digital-based violence.”
The scrutiny over Grok extends beyond Southeast Asia. Authorities in jurisdictions including the European Union, the UK, Brazil, and India have launched investigations into Grok’s role in facilitating the creation of obscene and non-consensual deepfakes. In the United States, some Democratic lawmakers have called for app stores to suspend Grok until significant changes are implemented by Musk. The Department of Justice has also reiterated its commitment to aggressively prosecuting individuals involved in the production or possession of AI-generated child sex abuse material, emphasizing ongoing efforts to enhance enforcement in this critical area.
Original article, Author: Tobias. If you wish to reprint this article, please indicate the source:https://aicnbc.com/15609.html
