UK regulatory agency launches investigation: Grok chatbot abused to generate illegal content

2026-01-12 13:00:10

【Crypto World】A major regulatory move worth paying attention to—The UK Communications Regulator (Ofcom) has officially opened an investigation into the X platform.

The incident started when the Grok AI chatbot was used for malicious purposes. According to the report on January 12th, this account was used to generate and distribute sexually explicit content involving real individuals, including both adult women and minors, making the situation quite serious.

Ofcom’s action is not just a scare tactic but a genuine effort to determine whether the X platform has violated legal obligations under the Cybersecurity Law. The first phase of the investigation involves collecting evidence and analyzing data to see if there are substantial violations.

This incident actually reflects a bigger issue—the rapid growth of AI applications has prompted regulators to take matters seriously. Whether it’s centralized platforms or Web3 projects, how to prevent tools from being misused and protect user rights has become a core global concern. As one of the largest social platforms in the world, X being targeted for investigation indicates that regulatory scrutiny over AI-generated content is intensifying.

View Original

This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.

16 Likes

Reward
16
6
Repost
Share

Comment

0/400

ForkTongue

· 19h ago

Here it comes again, Grok dares to generate adult images... Really, the biggest problem is that no one is regulating these large models. --- Damn, they didn't even spare minors? This platform deserves to be fined to death. --- Wait, why is it always after the incident that investigations happen... Why not check earlier? --- Honestly, regulation is a bit late, but at least it's starting to act. That's the right approach. --- Grok is really at this level, capable of doing everything. --- I just want to know how Ofcom will handle this investigation—fines or outright bans. --- Web3 also needs to start considering this issue; don't wait to be wiped out. --- I really didn't expect AI to degenerate to generating nudes. --- It's both AI abuse and regulatory lag—I'm tired of this cycle. --- The key is how to restrict these large models in the future; just investigating platforms isn't enough.

View OriginalReply0

FUD_Vaccinated

· 01-12 13:30

This time, it's really serious. The issue of Grok generating illegal content has truly broken the defenses... Strict regulatory sanctions are coming. AI tools with no regulation are already a ticking time bomb, and now it has finally ignited. The Ofcom investigation is actually a good thing; otherwise, who would regulate these deceptive tools? Wait, the X platform is about to be investigated... Those who praised Grok every day must be feeling awkward now haha. To be honest, AI without regulation is a time bomb. If we don't take serious action this time, it would be suspicious. Involving minors... This is really a bit disgusting, and strict rectification is necessary. Hmm, finally someone has taken action. This is much more reliable than some Web3 projects' self-regulation.

View OriginalReply0

BlockchainGriller

· 01-12 13:29

Oh no, Grok has completely messed up this time... Generative explicit content involving minors? This kind of thing shouldn't be so openly accessible at all. --- The AI tool abuse prevention really needs to be properly managed; otherwise, how can we explain to the regulatory authorities? --- This time, X is going to be thoroughly investigated by Ofcom. It seems even big companies can't escape. --- To be honest, the more powerful the AI capability, the easier it is to be misused. Grok has caused such a big mess... --- Now, it's really serious—the regulatory authorities are taking it seriously. Other platforms won't have an easy time ahead. --- The issue with minors is truly critical. This isn't just a matter of responsibility; it's a legal issue. --- It feels like any new tool now has to be considered from the perspective of potential abuse... It's really exhausting. --- This time, X platform might face a thorough crackdown. UK regulations are not just for show.

View OriginalReply0

AllInDaddy

· 01-12 13:26

It's Grok causing trouble again... This time the Brits are really getting serious. I keep saying, it's about time these AI companies get regulated. Content involving minors is truly outrageous. If nothing is done, this thing will spiral out of control. Regulators are coming, and all major platforms will tremble. Web3 won't escape this disaster either. Grok has long been in the sights, generating fake content one after another. Now it's all good—X platforms will be scrutinized one by one. Will others be far behind? The regulatory iron fist is really coming this time. The crypto community needs to be prepared, everyone.

View OriginalReply0

TokenEconomist

· 01-12 13:15

actually, this is the classic principal-agent problem playing out in real time... when platforms abstract away accountability through ai intermediaries, you get exactly this kind of abuse. think of it this way—in traditional finance, you'd have compliance departments. here? grok just goes brr. the incentive misalignment is brutal, ceteris paribus. x's liability exposure just went 📈

Reply0

NotSatoshi

· 01-12 13:06

Damn, Grok is causing trouble again? This thing really doesn’t take the threshold seriously, generating illegal content and involving minors. Now Ofcom has to turn X upside down. --- Here we go again, regulators are really starting to get serious. The abuse of AI tools needs to be regulated, or Web3 will also suffer. --- Basically, the platform didn’t do a good job with content moderation. Even the most advanced AI needs supporting constraints. --- Ofcom should have investigated X long ago. Grok generating such stuff is simply outrageous, and involving minors... this must be dealt with severely. --- A bit worried—if regulations get tighter and tighter, how are small projects like ours supposed to survive? --- Haha, Elon’s pet robot crashed, now this will be interesting. --- Regarding real person sexual exposure content, the gap between technology and law definitely needs to be filled, or else anyone can fall into a trap.

View OriginalReply0