I'm interested in how I can use this moving forward because I have personally found my app to be helpful for getting over a breakup.
My prompt is designed for Mindy to act as the "best of both worlds" between a real therapist and robot therapist, which means it will refer you to real therapy if it deems your problem too serious for a robot.
I'm not sure anymore however. I don't store any data for longer than the session is active, but I know OpenAI does. Also: OpenAI knows I am using their API for this purpose.
I'm really at a loss. I see the value and the harm. I'm going to have to do more thinking on this.
But I see your love, and I want to help!!
I have experience in PII and HIPPA and can see if we can address some of this stuff.
I think a conclusive terms of service, less specific questions, and storing it entirely in the browser if possible, will be a solid start .
My passion is from concern, not anger. I hope that comes across
If anything, I have positive faith in that ChatGPT or GPTn will be a great tool for therapy in the future.
As for the guy who killed himself, as sad as it is, I seriously doubt that ChatGPT made anything worse. With that said, the incident of course needs closer investigation to find out what advice the guy actually got.
A chat AI would have specific and professionally prepared training to handle people in distress, that's why I think it is in fact better that they talk to the AI rather than some untrained friend or relative.
This is of course just one aspect in how the above application is problematic, however.
First it’s sketch as fuck, second GPT is a guestimation engine and people are getting killed for asking it for psychological help. Someone in Belgium commit suicide to save the planet last month.
I love the drive and the idea, as someone who could benefit from this, but I have to shut this down hard.
As someone with significant mental health issues, and a moderate amount of experience with AI, who works with it daily, don’t mix them, please.
NEVER use GPT for financial, health, legal or other advice, as it’s not meant for that. Yes, it can simplify the research process, but always verify.
If you wanted to use a Language Model like this safely, you could load medical language models and ask questions about definitions, but never advice.
If you’re interested, I’d love to show you the basics, and I hate to shoot down other peoples good work, but not in this case.
Author: you’re probably not meaning any harm, but I have no way of knowing that.
You need to do far more research, far more legal considerations, and far more footwork to make this work.
Don’t be discouraged, but don’t get people killed with carelessness.