Meta to alert parents if teen discusses self-harm with AI chatbot
7 reported1 unconfirmed
Meta announced on Thursday that it will notify parents if their teen discusses suicide or self-harm with the company’s Meta AI chatbot. The company also said it is working on the ability to contact emergency services if conversations suggest a risk of self-harm. These changes come as Meta and other tech companies face scrutiny from regulators and parents over how AI chatbots respond to users in crisis, particularly teenagers. Meta stated it has built a dedicated AI system to identify conversations where a teen makes a clear reference to hurting themselves. The alerts are now live for parents using Instagram Parental Supervision in the U.S., U.K., Australia, and Canada, and will roll out globally by the end of the year. Meta also announced that its “Limited Content” setting, which lets parents place teens in a more restrictive experience on Instagram, now applies to Meta AI as well. Additionally, Meta said it will contact emergency services if a conversation with Meta AI, whether the user is an adult or a teen, suggests someone is at risk of suicide.
What’s reported
Meta announced on Thursday that it will notify parents if their teen discusses suicide or self-harm with Meta AI.
Meta is also working on the ability to contact emergency services if conversations suggest a risk of self-harm.
Meta built a dedicated AI system to identify conversations where a teen makes a clear reference to hurting themselves.
All flagged chats will be manually reviewed before an alert is sent, according to Meta.
Alerts are live for parents using Instagram Parental Supervision in the U.S., U.K., Australia, and Canada, with global rollout by year’s end.
The “Limited Content” setting now applies to Meta AI, expanding safeguards by making the chatbot decline a broader range of prompts.
Meta will contact emergency services if a conversation with Meta AI suggests someone is at risk of suicide.
Open questions
Meta did not specify what additional prompts the “Limited Content” setting blocks.
Sources: TechCrunch
