Anthropic now allows children to utilize its AI technology with certain restrictions

AI startup Anthropic is making a significant change to its policies by allowing minors to use its generative AI systems under certain conditions. The company announced this decision in a blog post on Friday, stating that teens and preteens will be permitted to use third-party apps powered by Anthropic’s AI models as long as the developers of those apps implement specific safety features and disclose which Anthropic technologies they are utilizing.

To ensure the safety of minors using AI-powered apps, Anthropic has outlined several safety measures that developers must include, such as age verification systems, content moderation, and educational resources on responsible AI use. Additionally, developers will need to comply with child safety and data privacy regulations like COPPA, with Anthropic planning to audit apps for compliance periodically.

The shift in policy comes as kids and teens are increasingly turning to generative AI tools for academic and personal support. OpenAI and Google are also exploring more use cases aimed at children, with OpenAI forming a team dedicated to child safety and Google making its chatbot Gemini available to teens in selected regions.

However, concerns about the potential negative impact of generative AI on minors have led to calls for guidelines and regulations on its usage in education. UNESCO has urged governments to regulate the use of generative AI in education, emphasizing the need for age limits, data protection, and user privacy safeguards. As the use of AI among minors continues to grow, it is essential to strike a balance between the benefits and potential risks associated with these technologies.