Malaysia and Indonesia restrict Grok over sexually explicit AI abuse

Malaysia and Indonesia have restricted access to Grok, the artificial intelligence chatbot associated with Elon Musk’s social media platform, X. This decision comes in response to concerns that the AI tool is being used to generate sexually explicit fake images of real individuals.

Grok enables users to create and modify images. However, authorities in both countries have expressed concerns that it is increasingly being used to manipulate photos into revealing or sexualised content without consent. Regulators have highlighted the risks to women and children, stating that the tool could easily be misused to produce pornographic deepfakes.

Malaysia and Indonesia are now the first countries in the world to entirely block Grok, taking a strong position against AI tools that authorities believe are advancing faster than safety regulations.

Grok crosses legal and social lines

Regulators are concerned about broader issues beyond a single chatbot, as the rise of AI-generated sexual images reveals gaps in online safety laws and poses risks to users. In Malaysia, the communications regulator noted that it previously warned X about the misuse of its AI, but felt the company’s response prioritised user reporting over addressing the core problem.

Indonesia’s digital affairs ministry emphasised the need for dignity and human rights, stating that AI tools creating non-consensual sexual content harm public trust and endanger vulnerable groups. The government has requested X to explain how Grok is being controlled and moderated.

The ban also reflects Indonesia’s long-standing stance on online content. The country has previously blocked platforms such as Pornhub and OnlyFans, and officials view AI-generated sexual images as an extension of the same issue, now delivered through newer technology.

Also read: Inside Grok’s deepfake pornography crisis and the legal reckoning ahead

The Grok controversy is gaining attention beyond Southeast Asia. In the United Kingdom, regulators are currently assessing whether X is complying with online safety regulations. Additionally, political leaders have publicly criticised the use of technology to create explicit fake images.

For users, the impact is personal. Some individuals whose images were altered using Grok report that reporting the content did little to prevent it from spreading. In certain cases, encouraging others to report the posts only resulted in more people seeing the fake images, exacerbating the harm.

The increasing backlash is prompting X to reconsider how Grok operates, particularly as governments begin to view AI tools as regulated products rather than experimental features.

The post Malaysia and Indonesia restrict Grok over sexually explicit AI abuse first appeared on Technext.