Tackling Mental Health Content on Social Media

In a proactive move to combat the spread of harmful mental health content online, the Mental Health Coalition (MHC) has launched a new program called Thrive.

• Thrive is a collaborative effort between leading online platforms, including Meta, Snap, and TikTok, aiming to enhance online safety measures and prevent the spread of harmful content related to suicide and self-harm.
• The program focuses on sharing "signals" or unique identifiers of potentially harmful content, allowing platforms to identify and address such content more effectively.

Thrive's Approach: Data Sharing and Collaboration

Thrive's strategy is based on a collaborative approach to content moderation.

• Platforms participating in Thrive share unique identifiers, known as hashes, of content related to suicide, self-harm, and harmful viral challenges.
• This data sharing enables platforms to detect and address similar content across their platforms, improving efficiency and effectiveness in content moderation.
• The hashes are designed to focus only on content and do not include any personal information, ensuring user privacy is protected.

Meta's Contribution and Previous Initiatives

Meta, one of the founding members of Thrive, has contributed the technical infrastructure for the program. This infrastructure is similar to the one used in the Tech Coalition's Lantern program, launched in November 2023, which focuses on combating online child sexual exploitation and abuse.

Thrive's Impact on Content Moderation

Thrive aims to empower platforms to more effectively address content related to mental health and safety.

• Participating platforms receive alerts about potentially concerning content that violates their policies.
• They can then independently assess the content and take appropriate actions, such as removing it or limiting its visibility.
• This collaborative approach facilitates the sharing of best practices and insights regarding mental health content moderation.

The Absence of X (Formerly Twitter) and Google

While Thrive boasts significant participation from leading online platforms, notable absences include X, the platform formerly known as Twitter, and Google, which owns YouTube.

• X, under the leadership of Elon Musk, has faced criticism for its content moderation practices and staffing cuts in the trust and safety department.
• YouTube has also been criticized for its failure to adequately protect users from harmful mental health content, with studies highlighting the platform's recommendation of videos encouraging or normalizing suicide among teenagers.

The Mental Health Crisis and Social Media's Role

The rise of Thrive reflects the growing concern over the impact of social media on mental health, particularly among young people.

• Studies have shown a connection between high social media use and increased risks of depression, anxiety, and body image issues.
• The exposure to harmful content, including suicide and self-harm, can exacerbate mental health challenges and trigger distress.
• While Thrive is a step towards addressing these concerns, the responsibility for safeguarding user well-being lies with all online platforms and their commitment to responsible content moderation.

Thrive's Potential for Positive Change

The Mental Health Coalition's Thrive program represents a significant initiative in the ongoing effort to combat mental health content online.

• By fostering collaboration between tech companies and sharing data about harmful content, Thrive has the potential to significantly improve content moderation practices.
• This collective effort is crucial to creating a safer and more supportive online environment for users, especially those struggling with mental health challenges.
• The program's success relies on the continued commitment of participating platforms and their willingness to prioritize user well-being and mental health.