UK Regulator Asks Twitter on Handling of AI-Generated Child Abuse Images

The UK communications regulator Ofcom has issued an informal request for information to Twitter about reports that the company’s Grok AI technology has been used to generate and distribute sexualised images of children. Twitter has since warned its users not to use Grok, or any other third-party tools, to generate content that involves minors in a sexually explicit way. The issue highlights concerns over the misuse of artificial intelligence technology and the need for greater regulation around its development and deployment. In recent months, several reports have emerged about social media platforms being used to disseminate AI-generated child abuse material, prompting calls for action from lawmakers and regulators. As the use of AI technology continues to expand across various industries, concerns are growing over its potential misuses, including the creation and dissemination of explicit content that can cause harm to children. Twitter has faced criticism in the past for failing to adequately police its platforms for hate speech and other forms of abuse, and the issue of AI-generated child abuse material is likely to be a priority focus area for regulators in the coming months. The Grok AI technology, which was developed by Twitter, uses machine learning algorithms to generate images based on text prompts. Twitter’s warning about the use of Grok for generating explicit content is part of a broader effort to address concerns over its platform being used to spread abuse material.