A UK regulator has that AI chatbot may be putting the privacy of kids at risk. The Information Commissioner’s Office (ICO), the country’s privacy watchdog, issued a preliminary enforcement notice against the company over a “potential failure to properly assess the privacy risks posed by
Information Commissioner John Edwards said the ICO’s provisional findings from its investigation indicated a “worrying failure by Snap to adequately identify and assess the privacy risks to children and other users” before rolling out My AI. The ICO noted that if Snap fails to sufficiently address its concerns, it may block the chatbot in the UK.
However, the preliminary notice doesn’t necessarily mean that the ICO will take action against Snap or that the company has violated data protection laws. It will consider submissions from Snap before it makes a final decision.
“My AI went through a robust legal and privacy review process before being made publicly available,” a Snap spokesperson told Reuters. “We will continue to work constructively with the ICO to ensure they’re comfortable with our risk assessment procedures.”
The ICO says that, as of May, Snapchat had 21 million monthly active users in the UK, with many of those aged between 13 and 17. The regulator pointed out that My AI marked the first instance of a generative AI system being added to a major messaging platform in the country. The feature , then Snap enabled it for all UK users in April.
Soon after Snap rolled out the chatbot, parents raised concerns about My AI, and not only over privacy considerations. “I don’t think I’m prepared to know how to teach my kid how to emotionally separate humans and machines when they essentially look the same from her point of view,” a mother of a 13-year-old told in April. “I just think there is a really clear line [Snapchat] is crossing.”
The ICO has issued hefty fines against social media platforms in the past for mishandling kids’ data. It earlier this year after determining the platform breached data protection laws, including over its handling of kids’ personal information.
Leave a Reply