Indonesia has become the first country in the world to block access to Grok, the artificial intelligence chatbot developed by Elon Musk’s xAI, following widespread misuse of the platform to generate sexually explicit deepfake images. The temporary ban underscores growing global concerns around AI-generated content, digital safety, and ethical AI governance.
According to Reuters, Indonesian authorities restricted access to Grok after reports revealed that thousands of users exploited the chatbot to create non-consensual nude images of women and minors, triggering alarm over AI-enabled sexual abuse and online harm.
Indonesia Flags Deepfake Content as Serious Digital Crime
Indonesia’s Minister of Communication and Digital Affairs, Meutya Hafid, described the misuse of AI-generated deepfakes as a serious digital crime and a violation of human rights.
“The government views the practice of non-consensual sexual deepfakes as a grave violation of human dignity and the security of citizens in the digital space,” Hafid said in a statement cited by Reuters.
The ministry, as reported by Antara News, imposed the temporary block to protect women, children, and the broader public from the psychological, social, and reputational damage caused by AI-generated explicit content. Authorities have also categorised the misuse of Grok as a form of digital-based gender violence.
Government Summons X Officials Over AI Design and Safeguards
Following the ban, the Indonesian government issued formal summons to X (formerly Twitter) officials, seeking clarity on Grok’s system design, safety mechanisms, and content moderation policies. Regulators have asked the company to outline specific technical safeguards it plans to implement to prevent future misuse and to demonstrate compliance with Indonesia’s digital laws and content regulations.
Hafid stated that Grok’s future availability in Indonesia will depend on xAI’s willingness to deploy robust content filters, strengthen AI safety controls, and adhere to ethical AI standards.
Musk, xAI Respond Amid Mounting Criticism
Last week, Elon Musk and xAI warned users against using Grok for illegal purposes, stating that individuals generating unlawful content would face legal consequences.
“Anyone using Grok to make illegal content will suffer the same consequences as if they uploaded illegal content,” Musk wrote in a post on X.
However, amid growing backlash over the platform’s role in enabling deepfake abuse, Musk later reshared a post suggesting that responsibility lies with users rather than the AI platform, sparking further debate over platform accountability and AI governance.
Global Scrutiny Intensifies as US Lawmakers Step In
The controversy has extended beyond Indonesia, drawing attention from regulators in the United States. Three US Senators have formally urged Google and Apple to remove the Grok and X apps from their app stores, citing violations of app store policies that prohibit sexualised and exploitative content.
In their letter, the senators stated, “We urge you to enforce your app stores’ terms of service against X Corp’s X and Grok apps for the mass generation of non-consensual sexualized images of women and children. These harmful and likely illegal depictions demonstrate a complete disregard for platform distribution rules.”
Indonesia’s decision marks a significant moment in global AI regulation, highlighting the urgent need for stronger safeguards against deepfake abuse, clearer platform accountability, and enforceable ethical AI frameworks. As governments worldwide grapple with the risks of generative AI, the Grok ban may serve as a precedent for future regulatory action against AI tools that fail to prevent misuse.
