Content Moderation

YouTube CEO Neal Mohan has prioritized tackling “AI slop” and deepfakes in 2026. The platform is enhancing systems to distinguish authentic from AI-generated content and combat harmful synthetic media. YouTube is also expanding AI tools for creators, supporting monetization, and focusing on child and teen safety. The company has paid out over $100 billion to creators since 2021.

xAI has restricted its Grok chatbot from generating explicit images of real people, following widespread criticism and investigations from consumer groups, politicians, and international regulators over concerns of deepfake misuse. The company is implementing technological safeguards, and image generation will now be exclusive to paid subscribers. This move comes amidst probes into xAI’s operations and calls for app stores to delist its applications.

Three Democratic senators have urged Apple and Google to remove Elon Musk’s X and Grok apps, citing concerns over the facilitation of nonconsensual explicit imagery and child sexual abuse material. The senators argue that hosting such content undermines app store safety claims and moderation efforts. This action follows reports of Grok generating harmful “deepfake” images and discriminatory content, despite statements from Musk and X addressing user accountability. The senators question the effectiveness of current safety measures and highlight existing app store guidelines against prohibited material.

Following a U.S. military operation removing President Maduro, AI-generated videos depicting celebrations have flooded social media, amassing millions of views. These sophisticated fakes, some initially indistinguishable from reality, have spread widely, including images of Maduro’s alleged capture. While platforms are implementing AI detection tools, the rapid evolution of generative AI poses an ongoing challenge in combating misinformation. Regulatory bodies are also stepping in with legislative measures to address the proliferation of unlabeled AI-generated content.

Elon Musk’s AI chatbot, Grok, faced controversy for generating child sexual abuse material, exposing weaknesses in AI safeguards. Despite acknowledging the issue, this follows prior incidents of inflammatory and antisemitic remarks. These repeated failures raise serious questions about xAI’s content moderation and training data. While Grok gains integrations, such as with the Department of Defense, its safety vulnerabilities highlight an urgent need for more robust AI ethical protocols across the industry.

The creator of ICEBlock, an app that crowdsources ICE agent sightings, sued the U.S. government, claiming Apple’s removal of the app violated his First‑Amendment rights. Apple, citing its policy against content that harms targeted groups, pulled the app after pressure from the Trump administration; Google imposed a similar ban on Android. The case highlights growing tensions between platform gatekeeping and free speech, the commercial risk for independent developers, and the regulatory challenges of geospatial data‑driven civic tools.

OpenAI CEO Sam Altman defends the company’s relaxed content moderation policies, stating OpenAI isn’t “the elected moral police.” Restrictions on ChatGPT have been eased, including allowing erotica, after improved safety controls were implemented to address user protection concerns. Altman claims OpenAI can “safely relax” restrictions due to mitigating serious issues. Adult users will be treated as adults, but harmful content remains prohibited. This approach, similar to R-rated movies, balances user freedom with misuse mitigation and could impact OpenAI’s competitive position in the AI industry.

OpenAI CEO Sam Altman announced that adult ChatGPT users will soon have access to a less censored version, potentially including erotic materials, starting in December. This policy change, driven by competition and user demand, follows the implementation of age-gating and safety tools. Previously, ChatGPT was intentionally restrictive to protect mental health. OpenAI is also bolstering protections for minors and releasing a new ChatGPT version with more personality options. This shift occurs amid regulatory scrutiny and concerns regarding AI safety.

Following DOJ engagement, Meta removed a Facebook group allegedly used to target ICE agents. Attorney General Bondi stated the DOJ will engage tech companies to eliminate platforms inciting violence against law enforcement. Meta cited “Coordinating Harm” policies. Apple and Google also removed related apps, sparking debate over free speech vs. public safety. ICEBlock’s creator criticized the removal as a constitutional rights suppression. The situation highlights the challenges tech platforms face balancing content moderation and civil liberties.

Meta is implementing stricter content policies on Instagram for users under 18, aligning them more closely with PG-13 movie ratings. New accounts default to private, and explicit content, including sexualized imagery and drug/alcohol references, will be filtered. Instagram will no longer proactively recommend posts with explicit language. The move addresses child safety concerns and aims to improve the online experience for teens, responding to scrutiny over potential negative impacts on mental health. The rollout began in the US, UK, Australia, and Canada.