Spotify, Reddit, and X all implement age guarantee systems to prevent children from being exposed to inappropriate content.
str | Nurphoto via Getty Images
The global online safety movement paves the way for many artificial intelligence-powered products designed to keep children away from potentially harmful things on the internet.
In the UK, a new law called the Online Safety Act places a duty of care on high-tech companies to protect children from age-appropriate substances, hateful remarks, bullying, fraud and child sexual abuse material (CSAM). Companies can face as fines as 10% of their global annual revenue for violations.
Even further, groundbreaking regulations aimed at keeping children safer online are driving the US Congress quickly. One bill, known as the Kids Online Safety Act, places social media platforms on responsibility to prevent products from hurting children.
This push from regulators is increasingly rethinking it for some key technicians. Pornhub and other online porn giants are blocking all users from accessing the site via their age verification system.
However, porn sites were not alone in taking action to confirm the age of users. Spotify, Reddit, and X all implement age guarantee systems to prevent children from being sexually exposed to explicit or inappropriate materials.
Such regulatory measures are filled with criticism from the tech industry. This is especially due to concerns that it could infringe the privacy of Internet users.
Prosperity of digital ID technology
At the heart of all these age verification measures is one company.
Yoti produces technology that captures selfies and uses artificial intelligence to verify someone’s age based on facial features. The company says that AI algorithms, which are trained on millions of faces, can estimate the ages of 13 to 24 within two years from accuracy.
The company has previously partnered with the UK Post Office and wants to take advantage of a wider push of digital ID cards issued by the UK government YOTI is not alone in the ID verification software space. However, the company is the most prominent provider of age guarantee services under the new UK regime.
“There’s a race for child safety technology and service providers to gain trust and confidence,” Pete Kenyon, a partner at Crips, the law firm, told CNBC. “The new requirements definitely create new markets and providers are in a hurry to make their mark.”
However, the increase in digital identification methods has also led to concerns over potential privacy breaches and data breaches.
“The use of this technology creates substantial privacy issues,” Kenyon said. “Trust is important and is only obtained through the use of strict and effective technical and governance procedures employed to keep personal data safe.”
Rani Govender, policy manager for Child Safety Insurance Online at the UK child protection charity NSPCC, said the technology “already exists” to authenticate users without compromising privacy.
“Tech companies must make intentional and ethical choices by choosing solutions that protect children from harm without compromising their users’ privacy,” she told CNBC. “The best technology isn’t just checking boxes, it builds trust.”
Child Safe Smartphone
The wave of new technologies that emerge to prevent children from being exposed to online harm is not limited to software.
Earlier this month, Finnish phone maker HMD Global launched a new smartphone called Fusion X1. This uses AI to prevent children from filming and sharing nude content, displaying sexually explicit images on camera, screens, and all apps.
The phone uses technology developed by Safetonet, a British cybersecurity company focusing on child safety.
The new smartphone from Finnish phone maker HMD Global uses AI to prevent children from exposing nude and sexually explicit images.
HMD Global
“We believe there is a need to do more in this area,” James Robinson, vice president of HMD’s Family Vertical, told CNBC. He emphasized that HMD came up with the concept of children’s devices before the online safety law came into effect, but said, “It’s great to see the government taking greater steps.”
HMD’s release of mobile phones for children is increasing momentum in the “smartphone-free” movement, which encourages children to avoid having their smartphones owned.
Going forward, the NSPCC government has said child safety will become an important priority for digital giants like Google and Meta.
The tech giant has been accused of worsening mental health for children and teens due to an increase in online bullying and social media addiction for years. They claim in return they have taken steps to address these issues through an increase in parental control and privacy characteristics.
“For years, the tech giants have been exposing and leaving young people vulnerable while harmful and illegal content spread throughout the platform,” she told CNBC. “That era of negligence must end.”
