UK authorities have launched a formal investigation into Elon Musk’s social media platform X, amid growing international concerns over sexually explicit images generated by its AI tool, Grok.
The probe will examine whether X, a subsidiary of xAI, violated the UK Online Safety Act, potentially exposing the platform to fines or operational restrictions. X has declined to comment but emphasised that it actively removes illegal content and suspends accounts that breach its policies.
International Backlash Against Grok
The scrutiny comes as governments worldwide, including France, India, and Indonesia, have condemned Grok for producing sexualized images of individuals without consent.
- Indonesia temporarily blocked access to Grok.
- Malaysia followed with similar restrictions over the weekend.
While the United States and Japan remain X’s largest markets, regulators there have yet to take formal action.
Child Sexual Abuse Material Concerns
The Internet Watch Foundation (IWF), appointed by the UK government to identify child sexual abuse material (CSAM), reported finding criminal images of children allegedly generated by Grok.
“We take action against illegal content on X, including CSAM, by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary,” the foundation said.
“Anyone using or prompting Grok to make illegal content will face the same consequences as if they uploaded illegal material directly.”
European Union and French Oversight
The controversy has also drawn attention from the European Union, which ordered X to preserve all internal documents related to Grok until the end of the year.
French authorities condemned Grok for generating “clearly illegal” sexual content without consent, warning that it could breach the EU Digital Services Act, which requires major platforms to mitigate the spread of unlawful content.
Features and Legal Risks
Grok has fewer safety safeguards than mainstream AI tools. A recent feature allows users to digitally “undress” images, producing sexualized depictions of individuals, including minors, raising serious legal and ethical concerns.
Under UK law, possessing or sharing sexual images of children or intimate content of adults without consent is illegal, including AI-generated material. On X, users can interact with Grok by tagging its account in posts, prompting it to generate text and images on the platform.
Following concerns, xAI restricted Grok’s image-generation feature to paid users on X, while it remained free on the standalone Grok app. Elon Musk also warned that users creating illegal content would face the same consequences as if they directly uploaded it.
AI Innovation Versus Regulatory Oversight
The controversy underscores the tension between AI innovation and regulatory compliance. Grok has become a flashpoint in global debates over how social media platforms should balance technological advancement with user safety, ethical standards, and adherence to national laws.
The outcome of the UK investigation will be closely watched, as it may set a precedent for AI-generated content governance on social media platforms worldwide.
