The issue of children’s safety online has become increasingly concerning, with tech giants facing protests worldwide not only over privacy concerns but also regarding the security of users online
In early February, during a Congressional hearing that could be described as hostile to not just Meta but also other tech majors including X, TikTok, Snapchat, and Discord, Meta CEO Mark Zuckerberg provided a public apology to parents whose children were victims of online predators. The hearing, titled “Big Tech and the Online Child Sexual Exploitation Crisis,” aimed to examine and investigate the prevalence of online child sexual exploitation, highlighting the responsibility of tech companies in safeguarding children on social media platforms.
A Major Concern
The issue of children’s safety online has become increasingly concerning, with tech giants facing protests worldwide not only over privacy concerns but also regarding the security of users online. Parents and activists are aggressively advocating for tech companies to take responsibility for providing platforms that are ‘safe by design’ for children and young users.
Last year, UNICEF released a report titled ‘The Metaverse, Extended Reality and Children,’ which analysed the potential evolution of virtual environments and their influence on children and young adults. But generative AI could also be used by bad actors or inadvertently cause harm or society-wide disruptions at the cost of children’s prospects and well-being,” the report records.
While these technologies offer numerous benefits in areas like education and health, they also pose significant risks. These risks include exposure to graphic sexual content, bullying, sexual harassment, and abuse, which can feel more ‘real’ in immersive virtual environments compared to current platforms. Additionally, vast amounts of data, including non-verbal behaviour, are collected, enabling hyper-personalised profiling, advertising, and increased surveillance, affecting children’s privacy, security, and other rights.
Although the complete immersion promised by the Metaverse is not yet realised, various virtual environments and games indicate dangers within that world. For example, in the popular game Grand Theft Auto, there are adult versions with instructions that may influence adolescent behaviour. Recent reports have also highlighted how children are using Artificial Intelligence to generate indecent child abuse images, further emphasising the risks.
Moreover, online solicitation and abuse can have severe mental health consequences for children, impacting their lives in the real world as well. Innocent sharing of images online can be exploited by predators. End-to-end encryption is essential to protect the information children share online.
How Generative AI Is Escalating Concerns?
Generative AI presents both opportunities and risks for children. While it can foster creativity and personalised learning experiences, it also poses risks such as spreading disinformation and impacting children’s cognitive development. Concerns also arise regarding the impact of human-like chatbots on young minds.
To address these challenges, tech companies must prioritise safety by design and adhere to child-centred AI guidelines. Governments play a crucial role in periodically assessing and adjusting regulatory frameworks to ensure that technologies do not violate children’s rights. They must also address harmful content and behaviour online.
Ultimately, protecting children online requires a collective effort, with stakeholders recognising the importance of applying real-world rules to the digital landscape. Everyone must work together to ensure the online safety and well-being of children.
