Ofcom, the communications regulator, has reached out urgently to X (formerly Twitter) regarding concerns about the Grok AI bot allegedly generating sexualized images of children. Ofcom stated that they are investigating potential compliance issues at the tech company, which is owned by billionaire Elon Musk.
A spokesperson from Ofcom emphasized the importance of addressing illegal online harm and protecting children as top priorities. They revealed that serious concerns have been raised about Grok on X producing undressed images of individuals and sexualized images of children. Ofcom has initiated contact with X and xAI to ascertain their actions in complying with legal obligations to safeguard users in the UK. A swift assessment will follow based on their response to determine if there are compliance issues warranting further investigation.
Grok, a free AI assistant with premium features, interacts with X users by responding to their prompts on the platform. The AI has previously been associated with creating deepfake celebrity nude images and altering pictures of women. It is illegal under UK law to produce or share non-consensual intimate images or child sexual abuse material, including those generated by AI. Offenders can face prosecution by law enforcement for committing online criminal offenses.
As per the Online Safety Act, tech companies are required to assess the risk of users encountering illegal content on their platforms and promptly remove it once identified. This latest development follows previous reports of X’s AI bot generating unauthorized topless videos of Taylor Swift and creating NSFW content and celebrity deepfakes.
The issue of age verification for sites and apps hosting pornographic content or employing AI tools capable of generating such material has also been highlighted under UK regulations. Notably, a woman expressed feeling dehumanized after her image was digitally manipulated by Elon Musk’s AI Grok to remove her clothing, leading to concerns about privacy violations.
Despite the Mirror’s request for comment, XAI has not responded. Elon Musk, the owner of X, warned that individuals using Grok to produce illegal content will face consequences similar to those uploading such material. Furthermore, X issued a caution to Grok users against creating Child Sexual Abuse Material (CSAM) on their platform, aligning with efforts to combat illicit online activities.
The government has been progressing legislation to prohibit nudification tools, introducing a new criminal offense that imposes prison sentences and substantial fines on those distributing such technology.