News for hackers. Stuff that matters.
Re:Illinois bans use of artificial intelligence for mental h... by jacobsenscott on Wednesday August 13, 2025 @06:10PM (#44894471)
It's already happening, a lot. I don't think anyone is claiming an llm is a therapist, but people use chatgpt for therapy every day. As far as I know no LLM company is taking any steps to prevent this - but they could, and should be forced to. It must be a goldmine of personal information.

I can't imagine some therapists, especially remote only, aren't already just acting as a human interface to chatgtp as well.

Re:Illinois bans use of artificial intelligence for mental h... by dingnuts on Wednesday August 13, 2025 @06:37PM (#44894708)
> I can't imagine some therapists, especially remote only, aren't already just acting as a human interface to chatgtp as well.

Are you joking? Any medical professional caught doing this should lose their license.

I would be incensed if I was a patient in this situation, and would litigate. What you're describing is literal malpractice.

Re:Illinois bans use of artificial intelligence for mental h... by xboxnolifes on Wednesday August 13, 2025 @07:04PM (#44894922)
Software engineers are so accustomed to the idea that skirting your professional responsibility ends with a slap on the wrist and not removing your ability to practice your profession entirely.
Re:Illinois bans use of artificial intelligence for mental h... by dazed_confused on Wednesday August 13, 2025 @07:36PM (#44895151)
Yeah in other professions negligence can lead to jail...
Re:Illinois bans use of artificial intelligence for mental h... by jacobsenscott on Thursday August 14, 2025 @01:09PM (#44902966)
You overestimate the vigilance of other professions. A Dr or Lawyer needs to screw up really badly, many times, before anything happens. They all go to the same country clubs.
Re:Illinois bans use of artificial intelligence for mental h... by lupire on Wednesday August 13, 2025 @09:16PM (#44895756)
The only part that looks like malpractice is sharing patient info in a non HIPAA way. Using an assistive tool for advice is not malpractice. The licensed professional is simply accountable for their curation choices.
Re:Illinois bans use of artificial intelligence for mental h... by tim333 on Thursday August 14, 2025 @08:18AM (#44899521)
In many places talk therapy isn't really considered a medical profession. Where I am "Counseling and psychotherapy are not protected titles in the United Kingdom" which kind of means anyone can do it as long as you don't make false claims about qualifications.
Re:Illinois bans use of artificial intelligence for mental h... by jacobsenscott on Thursday August 14, 2025 @01:07PM (#44902936)
I'm not joking. Malpractice happens all the time. You being incensed is not the deterrent you think it is.
Re:Illinois bans use of artificial intelligence for mental h... by larodi on Wednesday August 13, 2025 @09:47PM (#44895915)
Of course they do, and everyone does, and it's your like in this song

https://www.youtube.com/watch?v=u1xrNaTO1bI

and given price of proper therapy is skyrocketing.

Re:Illinois bans use of artificial intelligence for mental h... by thinkingtoilet on Wednesday August 13, 2025 @10:58PM (#44896316)
Lots of people are claiming LLMs are therapists. People are claiming LLMs are lawyers, doctors, developers, etc... The main problem is, as usual, influencers need something new to create their next "OMG AI JUST BROKE X INDUSTRY" video and people eat that shit up for breakfast, lunch, and dinner. I have spoken to people who think they are having very deep conversations with LLMs. The CEO of my company, an otherwise intelligent person, has gone all in on the AI hype train and is now saying things like we don't need lawyers because AI knows more than a lawyer. It's all very sad and many of the people who know better are actively taking advantage of the people who don't.