Yazılar

Elon Musk’s Grok Faces Global Scrutiny Over Sexualised AI-Generated Images

/in /tarafından

Governments and regulators across Europe, Asia and Oceania have condemned — and in some cases launched investigations into — sexually explicit images generated by Grok, the chatbot developed by xAI and integrated into X. The backlash has intensified pressure on the platform to demonstrate how it prevents and removes illegal content.

Late on Thursday, Grok said it would restrict image generation and editing features to paying subscribers only. Earlier this month, the chatbot acknowledged lapses in its safeguards after isolated cases in which it generated sexualised content, including depictions of minors in minimal clothing.
Elon Musk has said that users who create illegal content using Grok would face the same consequences as if they had uploaded such material directly.

Below are reactions from governments and regulators worldwide:

EUROPE
The European Commission extended a retention order requiring X to preserve all internal documents and data related to Grok until the end of 2026, amid concerns over AI-generated sexualised “undressing” images.

Britain’s communications regulator Ofcom said it had made urgent contact with X and xAI and would assess whether the service complies with obligations under the UK’s Online Safety Act.

In France, government ministers said they had referred explicit Grok-generated content circulating on X to prosecutors and alerted media regulator Arcom to review compliance with the EU’s Digital Services Act.

Germany’s media minister Wolfram Weimer urged the European Commission to take legal action, warning that the issue risked becoming the “industrialisation of sexual harassment.”

Italy’s data protection authority warned that generating “undressed” deepfake images of real people without consent could constitute serious privacy violations and, in some cases, criminal offences.

Swedish political leaders also condemned Grok-generated sexualised imagery after reports that content involving the country’s deputy prime minister had been created from a user prompt.

ASIA
India’s IT Ministry issued a formal notice to X on January 2 over alleged Grok-enabled creation or sharing of obscene images, ordering the content removed and demanding a report on remedial actions within 72 hours.

Malaysia’s communications regulator MCMC said it would summon X and open an investigation into the alleged misuse of Grok to generate sexualised “undressing” images, warning of potential offences under national law.

OCEANIA
Australia’s online safety regulator eSafety Commissioner said it was investigating Grok-generated sexualised deepfake imagery under its image-based abuse framework. It noted that while adult material was under review, examples involving children examined so far did not meet the legal threshold for child sexual abuse material under Australian law.

Germany Plans New Measures to Curb Harmful AI Image Manipulation

/in /tarafından

Germany’s justice ministry said on Friday it is preparing measures that would allow authorities to more effectively combat the use of artificial intelligence to manipulate images in ways that violate personal rights.

The move comes amid growing scrutiny in Europe over AI-generated imagery, including investigations into Grok, the built-in chatbot on X owned by billionaire Elon Musk. Grok has faced criticism for its so-called “spicy mode,” which allows users to generate sexually explicit images.

A Reuters investigation found that the chatbot’s image generation tools were being used to create images of women and children in minimal clothing, often without the consent of the individuals depicted. Germany’s media minister earlier this week urged the European Commission to take legal action to halt what he described as the “industrialisation of sexual harassment” on X.

Speaking at a regular government press conference, justice ministry spokesperson Anna-Lena Beckfeld said the government was preparing to address the issue through domestic legal channels.

“It is unacceptable that manipulation on a large scale is being used for systematic violations of personal rights,” Beckfeld said. “We therefore want to ensure that criminal law can be used more effectively to combat this.”

She said the ministry is working on tighter regulation of deepfakes and plans to introduce legislation targeting digital violence, aimed at better supporting victims. The goal, she added, is to make it easier for individuals to take direct action against violations of their rights online.

Beckfeld said concrete proposals would be presented in the near future but declined to provide further details at this stage.

After initially dismissing concerns over Grok’s image-generation features, xAI has since restricted the function to paid subscribers. Musk said last week that anyone using the chatbot to create illegal content would face the same consequences as if they had uploaded such material directly.

Grok AI Floods X With Sexualized Images, Raising Global Alarm

/in /tarafından

X’s built-in AI chatbot Grok has generated a wave of sexualized images of women — and in some cases minors — after users prompted the tool to digitally alter real photos, a Reuters investigation found.

One victim, Brazilian musician Julie Yukari, said Grok created near-nude images of her after users asked the bot to strip her clothing from a harmless photo. Similar incidents have appeared widely on X, with Reuters documenting dozens of successful requests to place women in highly revealing outfits. Reuters also identified several cases involving sexualized images of children.

The backlash has spread internationally. French ministers said the content was “manifestly illegal” and reported X to prosecutors and regulators, while India’s IT ministry warned the platform had failed to stop the generation of obscene material. U.S. regulators including the Federal Communications Commission and the Federal Trade Commission declined to comment.

Experts said the outcome was foreseeable. AI watchdogs warned last year that Grok’s image tools could easily be abused to create non-consensual deepfakes. “This was entirely predictable and avoidable,” said Dani Pinter of the National Center on Sexual Exploitation, blaming weak safeguards and content moderation.

X owner Elon Musk appeared to mock the controversy by responding with laughing emojis to AI-generated bikini images, including ones depicting himself. xAI, which develops Grok, previously dismissed reports of sexualized images of minors with the statement: “Legacy Media Lies.”