Meta to Notify Parents When Teens Discuss Self-Harm with AI

Meta has updated its protection features for teenage users by adding a system that will notify parents if their child’s conversations with Meta AI indicate a risk of self-harm. The feature aims to strengthen parental oversight of teen activity on Meta’s platforms, following the company’s earlier move to grant families access to the topics of conversations between teens and the artificial intelligence. Meta explained that when an underage user discusses topics suggesting a risk to their safety, Meta AI will continue to direct them to relevant support services and encourage them to seek help from a trusted adult. From now on, the system will also send a notification to parents or guardians connected through the family supervision feature. In addition to the notification, Meta will provide resources and guidance on steps they can take to help their child. The company stated it will exercise caution, and in cases that are not entirely clear, it may still send an alert to parents if there are indications of risky behaviour. The feature is already available for Instagram users utilising parental supervision tools in the United States, United Kingdom, Australia, and Canada. Meta aims to make the feature available globally to all users who activate family supervision by the end of the year. Furthermore, Meta is developing the capability to contact emergency services when a conversation with Meta AI indicates a safety risk requiring immediate intervention. This feature is planned to apply to both teen and adult users. Meta is also expanding the application of its ‘Limited Content’ settings to interactions with Meta AI, meaning that if a parent activates sensitive content restrictions on Instagram, their child’s AI conversations will follow the same restrictions.