Government moves to protect women and children as global scrutiny mounts on AI misuse
Indonesia has taken a firm stand against the misuse of artificial intelligence, halting access to a controversial chatbot after it was linked to the creation of explicit and harmful digital content involving real people.
Grok Suspension Sparks National Concern
Indonesia has temporarily suspended access to Grok, an artificial intelligence chatbot developed by Elon Musk’s xAI, after it generated sexualized images of real women and children. The Ministry of Communications said the decision was taken to protect women, children, and the wider public from fake pornographic content created using AI technology. Indonesia is home to the world’s fourth-largest population and has one of the largest social media user bases globally.
Government Cites Human Rights Violations
Communications Minister Meutya Hafid described non-consensual sexual deepfakes as a serious violation of human rights, personal dignity, and digital security. In an official statement, she stressed that such content poses real risks in online spaces, especially when it involves minors or real individuals whose images are manipulated without consent.
Pressure on X and xAI
Grok is integrated into X, the social media platform also owned by Musk. Indonesia has the world’s third-largest number of X users, increasing the potential impact of harmful content. Authorities have formally requested X to carry out a comprehensive technical, procedural, and governance-level review, and to remove any content that violates Indonesian law.
Growing Global Backlash
Indonesia’s move comes amid rising international concern. French authorities told Politico they are investigating sexually explicit deepfakes generated by Grok, while India’s government warned that the tool has been misused to create vulgar and derogatory images of women. In the United Kingdom, communications regulator Ofcom confirmed it had made urgent contact with X and xAI to assess compliance with legal duties to protect users, according to Business Insider.
US Lawmakers Call for App Store Action
In the United States, several senators have urged Apple and Google to remove X and Grok from their app stores. They argued that allowing continued access would undermine claims that app stores provide safer digital environments. The lawmakers described X’s handling of the issue as egregious and warned that inaction could weaken broader content moderation standards.
Company Response and New Restrictions
Musk responded publicly on X, stating that users who create illegal content with Grok would face the same consequences as those uploading illegal material directly. X’s safety team reiterated that the platform removes illegal content, suspends offending accounts, and cooperates with law enforcement. Following the backlash, Grok’s AI image generation feature has been restricted to paying subscribers only.
Indonesia’s decision reflects a growing global push to hold technology companies accountable for AI misuse, especially when it threatens human rights and digital safety. As Southeast Asia and major economies grapple with rapid AI adoption, the case highlights the urgent need for stronger safeguards that protect citizens while setting clearer boundaries for innovation across interconnected digital platforms.
Sources: Business Insider (2026) , The Guardian (2026)
Keywords: Grok AI, Deepfake Content, Digital Regulation, Online Safety, Indonesia AI Policy
