The creation or distribution of non-consensual intimate images will now be considered a criminal offense, as the prevalence of sexualized deepfakes on Elon Musk’s social media platform has prompted action. Technology Secretary Liz Kendall labeled images generated by X’s AI chatbot Grok as “instruments of abuse,” leading to an official investigation by Ofcom into the platform’s practices.
During an address to Parliament, Kendall announced the implementation of a new law that prohibits the creation or solicitation of non-consensual intimate images. Additionally, applications enabling the production of fake nude images will be outlawed under the Crime and Policing Bill currently advancing through Parliament. This legislation aims to prevent the distribution of tools facilitating the creation of non-consensual content.
Simultaneously, media regulator Ofcom initiated a probe to determine if X, formerly Twitter, has violated its legal obligations under the Online Safety Act. Ofcom has the authority to impose fines of up to £18 million or 10% of global revenue on X for non-compliance. It may also mandate business disruption measures, such as prompting payment providers and advertisers to disassociate from the platform.
Kendall emphasized the severe impact of non-consensual intimate images, particularly on women and girls, stressing that such content is a form of abuse and harassment. Urging swift action, she called on Ofcom to expedite its investigation, emphasizing that victims and the public expect decisive measures to be taken promptly.
Concerns were raised over the activities of Grok, with Ofcom reaching out to Musk’s X and xAI due to alarming reports of the AI tool generating sexualized images of minors. The Internet Watch Foundation discovered illicit imagery of children, potentially produced using Grok, raising serious alarm over child protection issues.
In response to criticism, X announced plans to offer deepfake creation as a paid service, a move condemned by officials as monetizing abusive content. Kendall warned that profiting from such material was unacceptable and emphasized the urgency of addressing these issues promptly to safeguard vulnerable individuals.