Ofcom urged to use 'banning' powers over X AI deepfakes

Ofcom Urged to Use ‘Banning’ Powers Over X AI Deepfakes

The government has called upon the regulator Ofcom to fully utilize its powers, potentially including a ban, on the platform X due to alarming issues regarding unlawful AI images generated on the site.

Concerns Surrounding AI Deepfakes on X

– Ofcom possesses the authority to secure a court order, which could restrict third parties from facilitating financial support or access to X within the UK.
– This demand follows significant backlash against X’s AI technology, Grok, which has been implicated in digitally altering images to remove clothing.
– There are growing fears around the potential creation of sexualized images of children, raising immediate concerns among government officials.

Government Response

– Prime Minister Sir Keir Starmer expressed strong disapproval of the situation, stating: This is disgraceful. It’s disgusting. And it’s not to be tolerated. Ofcom has our full support to take action in relation to this.
– He emphasized the unlawfulness of such actions, remarking, We’re not going to tolerate it. I’ve asked for all options to be on the table during an interview with Greatest Hits Radio.

Ofcom’s Powers and Potential Actions

– Government sources indicated to BBC News that they expect Ofcom to leverage all available powers regarding Grok and X.
– Under the Online Safety Act, Ofcom has only utilized its powers six times, which include a robust ability to petition the High Court for significant actions against non-compliant companies, including banning access to technology and funding.
– This process typically requires a thorough investigation, but could be expedited due to severe risks, especially concerning children and instances of non-compliance.

Future Directions for Ofcom

– A new chair for Ofcom is currently being appointed, expected to adopt a more aggressive stance on issues related to internet safety and national security amid rapid technological advancements and new ownership models.
– The Online Safety Act also raises questions regarding its implications for U.S. tech firms, drawing criticism from the Trump administration.

On Monday, Ofcom announced it had made “urgent contact” with X and xAI, the developers of Grok, and is actively investigating the reported concerns.

Current Legal Landscape

– Sharing deepfakes of adults is illegal in the UK. X has stated, Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.

The call for action against the AI deepfakes produced by Grok underscores the urgency for regulators to adapt to the evolving digital landscape and protect individuals from potential harm.

Leave a Reply