Update turns Google Gemini into a prude, breaking apps for trauma survivors
Google’s latest update to its Gemini family of large language models has resulted in significant issues for applications used by trauma survivors. Following the roll-out of Gemini 2.5, many apps that require specific content handling capabilities have been disrupted, putting vulnerable users at risk.
Key Points
- The recent Gemini update has broken the ability to configure safety settings, affecting applications for trauma survivors.
- Developers have reported that incident reports related to sensitive topics are being blocked as ‘unsafe content’ or ‘illegal pornography.’
- App creator Jack Darcy highlighted that his applications, designed to help survivors share their experiences, are now unusable due to these restrictions.
- Therapists using these tools to assist clients are experiencing disruptions in their services, which has caused distress among users.
- Other developers have also faced issues with the Gemini update, reporting significant regressions in model performance.
Why should I read this?
This article sheds light on a crucial and troubling update from Google that could have real-world implications for trauma survivors. If you care about the tech that impacts sensitive issues or work in mental health and support services, this is a must-read! It could save you time and help you understand the challenges emerging from these AI changes.