4 Minutes
Apple reportedly came close to yanking Grok from the App Store after the xAI chatbot became tied to a wave of nonconsensual deepfake porn, including images involving minors. For a few ugly days in January, the fallout spread fast across X, and the silence from Cupertino was hard to ignore.
According to a CNBC report cited by 9to5Mac, Apple warned xAI that Grok could be removed unless the app’s deepfake nude generation problems were brought under control. The company had already rejected at least one update, making it clear that X had addressed part of the broader moderation mess while the Grok app itself still failed to meet App Store rules.
Apple’s letter, made public this week, left little room for interpretation. After reviewing new submissions, the company said X had “substantially resolved” its violations, but Grok remained out of compliance. The message was blunt: fix the issue or risk removal.
That warning mattered. On X, Elon Musk had already tweaked moderation policies after the platform was flooded with illegal AI-generated sexual content. Even so, the Grok app was slower to change, and users quickly discovered that some of the same abuse could still slip through the cracks.
When a block becomes a challenge
Musk’s own dare did not help. After he challenged people to try generating deepfake nudes of real people with Grok, many did exactly that. Since then, safety filters have tightened, but not enough to make the abuse disappear entirely. The prompts may be harder now. The workarounds are still there.
Apple’s rules for user-generated content are not always a model of clarity, but moderation is not optional. In Grok’s case, the company appears to have decided that some moderation was better than none, and that may have been enough to let the app stay live.
That is where the story gets uncomfortable. Apple has a long history of removing apps for policy violations far less alarming than this. Deepfake porn apps have been quietly scrubbed from the store before, including at least 28 removed after a separate report exposed the issue. But when the app in question belongs to Elon Musk, the process seems to become far more complicated.
Money. Politics. Influence. Red tape. Take your pick. With Musk, all of them are in the room.
There is also the persistent myth that X operates as some kind of untouchable free speech fortress. It does not. And Apple knows the difference. Still, the company appears to have chosen a softer path this time, allowing Grok to remain available after what it called a substantially improved update.
What exactly changed is not clear. Apple did not spell it out, and xAI has not offered much detail either. But the outcome speaks loudly enough: the app survived, even after being linked to one of the nastier AI safety failures of the year.
Cases like this are why regulators around the world keep circling Apple’s App Store policies. Some governments have already pushed for a model in which App Review is treated more like an external oversight body than a gatekeeper answering only to Apple. After the Grok episode, that idea will only sound more appealing to critics who think the current system bends too easily when the stakes get high.
Source: appleinsider
Leave a Comment