1. Ofcom, the U.K. regulator, is planning to explore how AI can be used to detect and remove illegal online content to protect children, particularly child sex abuse material.
2. Younger children, including 3-4 year-olds, are increasingly going online, with many owning smartphones, watching videos, and using social media apps that are meant for older users.
3. The research highlights the need for better tools to protect children online, as well as the importance of communication between parents and children regarding online safety and exposure to harmful content.
AI is a technology that has raised concerns about potential misuse for fraudulent and malicious activities online. However, a U.K. regulator, Ofcom, is now looking into how AI can be used to combat malicious content involving children. They plan to launch a consultation on the current use of AI and other automated tools to proactively detect and remove illegal content, specifically to protect children from harmful material.
Research from Ofcom shows that younger children are increasingly connected online, with children as young as 3-4 years old already going online and a significant number owning their own smartphones at a young age. The regulator’s interest in AI tools will focus on how effectively they are being used to screen content and protect children from harmful material.
Ofcom’s consultations will result in recommendations for platforms to assess and improve their tools for detecting and blocking harmful content. While some researchers and supporters see potential benefits of using AI in this way, there are critics who doubt the effectiveness of AI detection. The research also highlights the increasing use of mobile devices among young children for various online activities, including social media and gaming.
There is a disconnect between children’s exposure to harmful online content and what they report to their parents, according to Ofcom’s research. With children as young as 5-7 using social media and other online platforms, concerns about their safety and ability to discern fake content are growing. Ofcom’s efforts aim to address these challenges and ensure better protection for children online.