1. AI startup Anthropic is changing policies to allow minors to use third-party apps powered by its AI systems, under certain safety measures.
2. Developers using Anthropic’s AI models for apps targeting minors must comply with child safety and data privacy regulations and may face account suspension for violations.
3. There is a growing need for guidelines on the usage of generative AI by kids and teens, with organizations like UNESCO pushing for government regulations in education.
In a recent announcement, AI startup Anthropic has updated its policies to allow minors to use apps powered by its generative AI systems, as long as certain safety measures are implemented by the developers of those apps. These safety measures include age verification systems, content moderation, educational resources on safe AI use, and compliance with child safety and data privacy regulations like COPPA.
Anthropic will periodically audit apps for compliance with these safety measures and may suspend or terminate the accounts of developers who repeatedly violate the requirements. The company aims to provide technical measures, such as a child safety prompt system, to tailor AI product experiences for minors.
This change in policy was motivated by the potential benefits of AI tools for younger users, such as test preparation and tutoring support. As kids and teens increasingly turn to generative AI tools for assistance with schoolwork and personal issues, other AI vendors like Google and OpenAI are exploring more use cases focused on children.
Despite concerns about generative AI apps leading to plagiarism and misinformation, some educational institutions have reversed bans on these tools. However, there is a growing call for guidelines on the usage of generative AI by children, with organizations like UNESCO urging governments to regulate its use in education to protect user privacy and prevent harmful outcomes.