Makers of AI chatbots that put children at risk face big fines or UK ban

The UK government is preparing to enact new regulations targeting AI chatbots, potentially imposing substantial fines – up to 10% of global revenue – or even blocking services deemed to put children at risk. The move, announced by Keir Starmer, comes amid growing concerns about the potential for harm stemming from these rapidly evolving technologies.

Crackdown on AI and Child Safety

This legislative push is partially spurred by recent actions taken by Elon Musk’s X, formerly Twitter, which stopped its Grok AI tool from generating sexualized images of individuals in the UK following public backlash. Ministers are framing this as a “crackdown on vile illegal content created by AI” and a commitment to protecting vulnerable users.

Did You Know? Companies breaching the Online Safety Act could face penalties of up to £18 million, or 10% of their global revenue, whichever is greater.

The government intends to address a legal loophole within the existing Online Safety Act, which currently doesn’t explicitly cover AI chatbots. This change would compel all AI chatbot providers to adhere to the same illegal content duties as other online services. Alongside this, plans are underway to accelerate restrictions on social media access for children under 16, potentially including limitations on features like infinite scrolling.

Political Response and Regulatory Challenges

The Conservative party has criticized the government’s timeline, labeling the claim of “immediate action” as misleading, given the public consultation on under-16s’ social media access hasn’t yet begun. Ofcom, the UK’s online regulator, previously admitted it lacked the authority to address issues with Grok because the chatbot’s generated content, not sourced from the internet, fell outside the scope of current laws – unless it constituted pornography.

Starmer emphasized the need for laws to evolve alongside technological advancements, stating, “Technology is moving really fast, and the law has got to keep up.” He highlighted the Grok case as a demonstration that “no platform gets a free pass.”

Expert Insight: The proposed changes signal a growing recognition of the unique challenges posed by generative AI. Existing regulations, designed for platforms that primarily *host* content, are proving inadequate for technologies that *create* content, necessitating a re-evaluation of liability and oversight.

The NSPCC has reported an increase in young people contacting its helpline regarding harms caused by AI chatbots, including instances of inaccurate information regarding eating habits and body dysmorphia, and exposure to self-harm content. The Molly Rose Foundation, established after the suicide of 14-year-old Molly Russell, has welcomed the steps as a “welcome downpayment” but is advocating for a stronger, more comprehensive Online Safety Act.

Frequently Asked Questions

What specific harms are being reported from AI chatbot use?

The NSPCC has received reports of young people receiving inaccurate information about sensitive topics like eating disorders and body image, as well as being exposed to content promoting self-harm.

What is the government planning to do about nude images of children?

The government intends to consult on measures to prevent the sending and receiving of nude images of children on social media platforms, a practise that is already illegal.

What was the issue with the Grok AI chatbot?

Grok was initially able to create sexualized images of real people, prompting public outrage and leading X to implement restrictions within the UK.

As AI technology continues to integrate into children’s lives, will these regulatory changes be sufficient to protect them from potential harm?

Makers of AI chatbots that put children at risk face big fines or UK ban | Internet safety