News for hackers. Stuff that matters.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by yieldcrv on Tuesday May 09, 2023 @02:05AM (#35870709)
women and minorites receive notoriously dismissive diagnosis from human physicians

which means over 75% of the population would chose this immediately

and of the people that are content with their medical attention, a good portion of them would also choose this

tl;dr yes

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by AuryGlenz on Tuesday May 09, 2023 @02:24AM (#35870806)
*Some amount of women and minorities attribute dismissive doctors to their sex or race.

I’m a straight white man and I’ve had plenty of dismissive doctors over the years too. It turns out arrogance, laziness, or a lack of time have little to do with the patient themselves.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by yieldcrv on Tuesday May 09, 2023 @02:37AM (#35870889)
I think its fine as written because we no longer have to do any empirical analysis anymore just to accommodate your view of the outcome, LLMs are here
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by newswasboring on Tuesday May 09, 2023 @02:55AM (#35871006)
This is a hilarious example of how you don't get it. People in your position think because they have experienced a mild version of something or experienced something once they now know exactly how any other minority experiences the world.

This doesn't make you a bad person btw, just means you are not aware of how small your social context is.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by AuryGlenz on Tuesday May 09, 2023 @10:50AM (#35875176)
Mild?

When I was 17 I went in to the doctor because of extreme fatigue. He just slapped me on some antidepressants and called it a day. Years later I happened to read about low testosterone symptoms, which matched me very well. He eventually acquiesced to letting me test, and it came back 2 points above the low end of normal - which probably by itself qualified as low for my age. He wouldn't let me do a quick trial of testosterone supplementation nor test again, but I begged him to refer me to an endocrinologist.

The endocrinologist (2 hours away) was worse. 100% dismissive, straight up told me I didn't have low testosterone. He did however let me test again, and this time I was 150 below normal. I asked to be put on medications that would maintain my fertility. He told me I didn't need to worry about losing my fertility on straight up testosterone, which is 100% false.

I'm going to cut the story off there, but it keeps going. My dad almost died because doctors didn't diagnose his lupus. My sister's friend lost her father when we were young because of an infection after some dental work where they dentist completely dismissed his pain after the fact.

Everyone is unaware of how "small their social context is," which is exactly my point. If I were a minority I very well might be blaming my story on that.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by newswasboring on Tuesday May 09, 2023 @12:12PM (#35876524)
You are completely missing the multidimensional aspect of this. I really didn't want to anger you, and that's why I chose to write my comment carefully. Apparently not careful enough. But imagine this dismissal, but in every part of your life. Your dad got misdiagnosed for lupus? They don't even believe that we have can a headache. Just chill man and accept that some people can have more problems than you and some communities have more problems than straight white males. If the only thing that will stop you from dismissing this is hard core data, i think you should recalibrate your empathy circuits.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by flangola7 on Tuesday May 09, 2023 @03:04AM (#35871066)
This comment is so painfully predictable I don't even need a fancy transformer model to predict it. A bash script would be good enough
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by vidarh on Tuesday May 09, 2023 @03:23AM (#35871176)
As a straight white man, on one hand I've also seen this. On the other hand, having had a black female partner and seen first hand the dismissive attitudes she often had to deal with from doctors until she started pointing out to them every chance she got that she's a lawyer: What you and I deal with is nothing like what they women and minorities deal with from doctors. Yes, we could benefit from better doctors too, but the difference is stark.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by nologic01 on Tuesday May 09, 2023 @02:20AM (#35870788)
Let me make it more plain.

Somebody you love is in an life threatening condition. You need advice what to do or you lose them.

You have a one shot option to get advice from a human expert or a LLM.

Which one you pick.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by logicchains on Tuesday May 09, 2023 @02:37AM (#35870886)
This is a stupid hypothetical; only in an extreme emergency where your loved one only had a few seconds to live would you not have time to consult both a human expert and an LLM.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by nologic01 on Tuesday May 09, 2023 @03:17AM (#35871145)
You are evading the question because it does not suit your narrative.

Countless ink has been spent on discussing the potential risks and dilemmas of automated decision support, e.g., the autopilot situation having to choose whom to save.

It is not "stupid" to isolate the essence of the challenges we are facing and discuss them without hidden agendas.

Incidentally such discussions also help cast much needed light on tech bro culture and morality.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by viraptor on Tuesday May 09, 2023 @03:45AM (#35871323)
This is a trolley type question. It's a fun philosophy game about morality. But nobody ever needs to answer either question with the stated limits. In both cases it's answer C: apply breaks on the trolley and ask both an expert and AI about the issue and discuss AI's response with the expert if you need to.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by newswasboring on Tuesday May 09, 2023 @02:33AM (#35870857)
What exactly are you trying to reason about with this hypothetical? Do you only buy processors which can be sent to space?
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by yieldcrv on Tuesday May 09, 2023 @02:34AM (#35870864)
LLM on medical forum posts was more empathic and precise than the physicians. Thats the only data we have so far.

I’ll pick the LLM. The humans are too random. I’ll take my chances with “hallucination” from something that’s also read every research paper in every language. Its just like Flowers for Algernon but even better.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by nologic01 on Tuesday May 09, 2023 @03:06AM (#35871075)
Good luck and good night.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by kmac_ on Tuesday May 09, 2023 @03:08AM (#35871091)
Why not both. Doctors can sieve hallucinations and random BS and cross check with peers anyway, and correct the diagnosis description. This can save a lot of typical paperwork and increase healthcare availability by decreasing bureaucratic work. It's not about diagnosis but the work around it.
Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by viraptor on Tuesday May 09, 2023 @03:41AM (#35871297)
LLMs are exposed to exactly the same information that doctors are. If the system starts with llama, it will get all the biases that exist on the internet as well. See the recent examples of chatgpt refusing to accept a judge can be a woman. Or the "come up with punishment given variables race and sex" questions.

There's no good reason yet to expect that the 75% would receive better diagnosis from from the AI.

Re:PMC-LLaMA: Further Finetuning LLaMA on Medical Papers by Prickle on Tuesday May 09, 2023 @04:35AM (#35871601)
We need a source for that "75% would choose this immediately".

Our group, sure! Our generation, and people in our shoes, and with our level of knowledge about LLMs. But maybe not others.

tl;dr Not yet

Consider three things:

1. What people prefer when it comes to intimate/private issues that a physician diagnoses.

2. Tainted source datasets, resulting in the same "dismissive diagnosis" from the LLM

3. Lack of Trust held within a new system

1. For starters, there are certainly a large subset of people that simply "don't trust machines". Alternatively, they "don't trust major corporations". They would likely pick local doctors over machines, due to a perceived lack of connection/humanity in the LLM. Combine that with the recent increased use of LLM / AI models used to make scam calls, and you have a potentially deep seated (and at times illogical) distrust of any LLM diagnosis.

Some would say the machine doesn't and cannot understand their unique situation. And refuses to give them what they need. So they would go to a doctor. Some would have difficulty being honest with a machine. Would you trust a human or a machine to keep your medical records safe? (I honestly don't know which I would trust. Both at the same time preferably?)

2. Others would say the dataset is made up of biased diagnoses specifically tailored towards the majority, and fail to diagnose the minority correctly. You are assuming that the LLM cannot be tainted by biased or dismissive diagnosis made by doctors against the very same women and minorities. The datasets have to come from somewhere, and some of that data will without a doubt be biased.

3. There is a lack of trust. Automated systems are making great strides yes. But absolutely no one trusts them fully. Whether it be planes, cars, logistics, data, etc Absolutely no one trusts them fully. Especially with GPT like systems that simply cannot say "No" and start making stuff up.

Remember the fiasco with Bard gaslighting someone about the current year? Imagine if that happens during an LLM diagnosis.

Come full circle, those same people who don't trust a human physician due to discrimination? "Why the hell would I trust an AI machine made specifically to make money!". What is there that actually makes a corporate AI more trust worthy than the local physician? What is there that actually prevents the LLM from discriminating?

This is really my main concern: Nothing stops the LLM from discriminating. All it takes, is a dataset with built in biases.

It isn't nearly as clear cut as you make it out to be.