Brazilian authorities have given xAI, founded by Elon Musk, 30 days to prevent its Grok chatbot from generating and circulating fake sexualized content, warning of further legal action if the company fails to comply.
In a joint statement, Brazil’s consumer protection agency Senacon, data protection authority ANPD, and the Office of Federal Prosecutors said xAI must introduce technical measures to identify, review, and remove inappropriate content created by Grok. Authorities also demanded the removal of accounts linked to the production of such material within the same timeframe.
The move follows concerns that Grok has continued to generate hyper-realistic sexualized imagery, sometimes described as deepfakes. While xAI has previously restricted image editing features and rolled back public posting of such imagery on the X platform, a Reuters test showed that the chatbot could still privately generate the content on request.
Brazilian officials said they may pursue administrative or judicial measures if the company does not meet the deadline. The action forms part of a broader global crackdown, as governments and regulators increase scrutiny of AI-generated sexual content, launching probes, imposing bans, and demanding stronger safeguards to prevent the spread of illegal material.
The case highlights mounting pressure on AI developers to balance innovation with effective content moderation as increasingly powerful generative tools enter public use.