Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by SamoyedFurFluff on Friday August 25, 2023 @09:36AM
(#37261569)
> In my opinion being 100,000x lower cost gives such a system some leeway in being worse and I think most patients would agree.
I would heavily disagree with this. We had an AI counselor actively encouraging disordered eating and triggering people into relapse on an eating disorder helpline from logic like this.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by AbrahamParangi on Friday August 25, 2023 @09:46AM
(#37261678)
While I understand that some will disagree, it’s not like there’s an objective standard against which we are measuring both the AI and the human counselors to begin with.
Without a standard it’s just anecdotes and with a standard there’s clarity on when the increased costs no longer justify the lower access and potentially higher quality. I suspect that if we instituted an objective standard we would find that AI is already capable of meeting or exceeding some proportion of people currently employed in the role today.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by SamoyedFurFluff on Friday August 25, 2023 @11:11AM
(#37262611)
This cannot possibly be the case when there was a clear A/B test scenario here. AI was dropped in, nothing else changed about the website, suddenly cases of relapse and worsening conditions went up.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by AbrahamParangi on Friday August 25, 2023 @03:34PM
(#37266110)
I think you're confusing my statement that "it could be done well" with "your team did it well"
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by explaininjs on Friday August 25, 2023 @09:47AM
(#37261695)
And I’m very familiar with AMA-certified (TM) “doctors” who have done the same.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by SamoyedFurFluff on Friday August 25, 2023 @11:10AM
(#37262596)
In this case there’s a fairly clear A/B test where if we dropped in an AI instead of hired counselors, the number of negative outcomes went up.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by 0xcde4c3db on Friday August 25, 2023 @12:55PM
(#37264043)
I've read that it's largely the residency system (which, from the outside, feels more like hazing than training) that limits positions, and I don't think that's under any direct control by the AMA. Wikipedia says it's mostly funded by Medicare.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by dontupvoteme on Friday August 25, 2023 @01:08PM
(#37264252)
The residency system is insane, iirc was founded by a guy who was constantly on coke and then took heroin to sleep. Then that became the standard.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by xigency on Friday August 25, 2023 @02:21PM
(#37265283)
It’s an incredibly dangerous and unethical practice that is universal in US hospitals.
Re:Finetuning of Falcon-7B LLM Using QLoRA on Mental Health ...
by AbrahamParangi on Friday August 25, 2023 @03:41PM
(#37266177)
The AMA lobbies to keep the supply of residency slots restricted* in 1997 the AMA successfully lobbied to freeze the funding for new residency slots at 1996 levels. Lobbying by the AMA is also no small part of why it's so hard for a foreign-born doctor to practice medicine in the US.
*although in the face of the incredible pressure they're about to face from AI they may be opening up
In my opinion being 100,000x lower cost gives such a system some leeway in being worse and I think most patients would agree.