News for hackers. Stuff that matters.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by PragmaticPulp on Saturday April 29, 2023 @10:01AM (#35752933)
Outperforms Physicians answering questions on a public subreddit:

> In this cross-sectional study, a public and nonidentifiable database of questions from a public social media forum (Reddit’s r/AskDocs) was used to randomly draw 195 exchanges from October 2022 where a verified physician responded to a public question

They didn’t go to physicians in a patient setting. The physician answers were taken from Reddit threads where they were interacting with people who were not their patients.

Reddit has its own dynamic and people tend to get snarky/jaded. Using this as a baseline for physician responses seems extremely misleading.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by corey_moncure on Saturday April 29, 2023 @10:14AM (#35753054)
If they went to a physician in a patient setting, they may have had an experience like this:

  -Made to wait 45-60 minutes past their appointment time bombarded with pharmaceutical advertisements
  -Spend another 20 minutes sitting in the examination room staring at pharmaceutical company sponsored ads
  -Nurse takes your history with a bunch of redundant questions they already have the answers to
  -Finally the physician arrives
  -Assesses the patient without laying their hands on them
  -Ignores everything you say
  -Does no tests and cultures no pathogens
  -"take some antibiotics and I'll bill your insurance company $500, see ya"
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by speedgoose on Saturday April 29, 2023 @10:27AM (#35753172)
It depends on the location. In Norway they are usually perfectly on time, you don’t have any ads, they do the required tests and examinations, they listen to you, they take the time to explain everything and will do drawings if necessary, they tell you to do more sport, and you get billed about $25 (but it becomes free if you spend more than $300 in visits and medications during the year).
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by mensetmanusman on Saturday April 29, 2023 @10:54AM (#35753451)
Might be a consequence of oil wealth offering a government savings rate of $200,000 per citizen?
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by tbossanova on Saturday April 29, 2023 @11:22AM (#35753776)
There are other places with a similar experience that don’t have the same oil wealth. I wonder though if it’s different at the higher end of things, like expensive treatments for major issues which a tighter public purse might not stretch to.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hgsgm on Saturday April 29, 2023 @12:38PM (#35754499)
That's an asset, not a savings rate.

USA's mean household Net Worth is $500K more than Norway's, and average household is about 3 people (some households are single people) so the oil fund approximately cancels that out.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by speedgoose on Saturday April 29, 2023 @01:13PM (#35754870)
No, I don't think the oil fund (https://www.nbim.no/en/) is responsible for the culture to be on time or is connected directly to the public healthcare finances. Though being a state with money helps, obviously.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by kwhitefoot on Saturday April 29, 2023 @03:12PM (#35756100)
Perhaps you could explain how a fund that doesn't invest onshore does this. The government uses only a small percentage of the return on the fund (not the capital) each year.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by cscurmudgeon on Saturday April 29, 2023 @11:33AM (#35753893)
Even in the US you don't get Pharma ads in a hospital.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ericbarrett on Saturday April 29, 2023 @12:26PM (#35754385)
Have you ever seen those brochures and flyers in the waiting room (and sometimes even the exam room)? Those are almost entirely supplied to the practice by pharma reps. Every U.S. doctor's office I've been in for the last four decades has been full of them.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by cscurmudgeon on Saturday April 29, 2023 @01:32PM (#35755059)
I have seen zero such brochures in every US doctor’s office I have visited. Zero.

Is there any study that shows how prevalent they are?

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by andsoitis on Saturday April 29, 2023 @06:07PM (#35757730)
Besides brochures, these ads also come in the form of posters and bulletin board posts. Next time, also look at the walls.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by salad-tycoon on Saturday April 29, 2023 @08:58PM (#35758765)
Not to say that you had a very unique set of experiences but having been in many doctors offices and worked in a number, in the US there are generally brochures, pamphlets, pens, note pads, and the worst of all TV SCREENS advertising pharma crap.

The only place I haven’t seen brochures is my direct patient contract doctor (concierge) and even then he has natural herbal supplements for various things.

So just saying your experience is atypical. But it sounds like a dream.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by cscurmudgeon on Monday May 01, 2023 @12:36AM (#35769130)
Curious, are there any references? I have seen zero. Of course, I see tons of ads on TV so if the Dr.'s office has TV on, that may be one source. But I am curious about ads outside of the TV, haven't any like that in a Dr's office.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by throwaway675309 on Saturday April 29, 2023 @07:03PM (#35758136)
It only takes one person's evidence to prove your generalization wrong. My last visit to a podiatrist had dozens of ads on the walls and television that was airing nonstop commercials for medical products. Nothing makes for a better captive audience than excruciatingly long wait times.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by kldx on Saturday April 29, 2023 @12:01PM (#35754158)
> perfectly on time

> they do the required tests and examinations

Do you have a source or is this anecdata? I do agree with your other claims though.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by speedgoose on Saturday April 29, 2023 @01:15PM (#35754886)
Not really. I said that based on the experiences from my close family. The sample size is small.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by kldx on Sunday April 30, 2023 @05:41AM (#35761042)
My experience (N=~5) is that the waiting times for legevakten are in the order of a couple of hours for anything non trivial. I have also observed some reluctance on preventative tests at the fastlege.

I don't mean to contradict your observations, but our experiences could have been different based on our age, location, gender and what we're being treated for. Selecting a good GP matters a lot too.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by WheatMillington on Saturday April 29, 2023 @03:14PM (#35756123)
I'm in New Zealand and my experience matches the GP comment, except cost and pharma ads. Long wait times and disinterested doctors are the norm.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by pizza234 on Sunday April 30, 2023 @08:03AM (#35761786)
I personally have a good exprience with good doctors (which one, with some time, can find), but perfectly on time is not realistic, as time with patients can't be predicted.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by SkyMarshal on Saturday April 29, 2023 @10:26AM (#35753160)
That last one is more like:

    -“take some antibiotics and our billing dept will bill your insurance company for the maximum amount they estimate your insurance can pay, plus some margin, see ya”
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Retric on Saturday April 29, 2023 @10:24AM (#35753144)
If that’s your experience, find a new doctor.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by VancouverMan on Saturday April 29, 2023 @11:03AM (#35753555)
It may not be that simple, especially in regions where there isn't anything resembling a free market in the health care sector.

Canada's various provincial public health care systems (with a corresponding lack of private health care offerings) tend to be like that.

Many Canadians don't have a dedicated physician. Even if they want one (or want a new one), it's often difficult, if not impossible, to find one who's close by and who's accepting new patients.

Having a dedicated physician still often results in an experience much like that other commenter described. It's not an exaggeration. Long waits even with appointments, rushed examinations, and low-quality service are the norm.

Another option, which is sometimes used even by people who have dedicated physicians, is a walk-in clinic. Unfortunately, they can be quite rare and inconvenient to get to, even in Canada's largest cities, assuming they're even open when you need them. You'll usually face an even longer wait, even less time with the doctor, and typically see a different doctor if any sort of followup is needed.

Then there are hospital emergency rooms. That usually means getting to the nearest sizable city, and even once you're there, you've got to be prepared to wait many hours, even for relatively serious situations.

Ultimately, in Canada, it doesn't matter whether you see your family doctor (if you even have one), use a walk-in clinic, or go to a hospital emergency room. It's going to be a horrible experience, and there's pretty much nothing the average person can do about it.

Given the lack of competition and due to other government-imposed market distortions, there's no incentive for doctors to offer anything resembling good service to the general public.

The best situation is to have a doctor who's a close friend or family member, and who may be able to help mitigate at least some of the typical problems.

The next best option for Canadians, assuming they have the money for it, is often to seek treatment in the US or overseas.

Just "finding a new doctor" isn't feasible, unfortunately.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Retric on Saturday April 29, 2023 @03:29PM (#35756262)
It is that simple even if it’s inconvenient.

Being forced to wait for routine care isn’t a big deal, but having a doctor unwilling to listen to you is a life threatening situation.

If your local area lacks access to proper medical care that’s a serious enough problem where you should move. Medical care is like clean drinking water or working breaks for your car, it’s not optional.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by andsoitis on Saturday April 29, 2023 @06:13PM (#35757773)
> The best situation is to have a doctor who's a close friend or family member

The code of medical ethics advises physicians to not treat themselves or members of their own families.

https://code-medical-ethics.ama-assn.org/ethics-opinions/tre...

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by javajosh on Saturday April 29, 2023 @10:29AM (#35753193)
Accurate. This is a result of the heady combination of relying on the profession to enforce ethical codes, and letting corruption become standard practice, and therefore common and safe. That medicine is NOT a free market is easy to prove, because as soon as you posit a provider that keeps their appointment times, charges a reasonable fee for a short consult, actually looks at you and performs tests himself, relates to your whole being as a human on this planet, and charges something like $100/hour, cash - imagine how that poor schmuck is going to fare in this hard, harsh world of ours. As soon as they need to interface with literally any other part of the system, the other providers, pharmacies, etc will not be able to handle them - and won't want to. Won't need to. Many of their colleagues will sneer at them or even refuse to refer. Some patients, the sociopaths, will sense weakness, the lack blood-thirsty corpo apparatus backup that deals with 10 frivolous lawsuits a day, and say "what the hell" and sue you for malpractice simply because they think you're unprepared and they can win.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Firmwarrior on Saturday April 29, 2023 @11:54AM (#35754080)
I had some doctors like that

To be fair, they were so heavily booked that they weren't taking new patients and you had to wait weeks or months for non-urgent visits

Also some of them went out of business..

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by musicale on Saturday April 29, 2023 @05:16PM (#35757285)
I wonder if things like CVS's minute clinic are any better for basic stuff vs. the hell of regular clinics.

The potential seems there: cash payments accepted, many convenient locations, possibly lower wait times.

Of course CVS is Aetna, for better or for worse.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by tgv on Saturday April 29, 2023 @10:25AM (#35753154)
> Assesses the patient without laying their hands on them

That’s not a killer argument in a comparison with an AI.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by User23 on Saturday April 29, 2023 @10:40AM (#35753301)
* * *
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by tgv on Saturday April 29, 2023 @11:26AM (#35753816)
An AI couldn't touch anyone even if we could give it the desire to do so.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hgsgm on Saturday April 29, 2023 @12:41PM (#35754533)
The point of that thread starting comment was that it's what a bad doctor does. The reply was saying good doctors can do better.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by seszett on Saturday April 29, 2023 @10:46AM (#35753361)
This sounds like hell but it's also infinitely different from how it works here (in Western Europe, but I'd assume it's different from almost anywhere but the US). Also, pharmaceutical ads are forbidden here, and antibiotics are very sparsely used.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ben_w on Saturday April 29, 2023 @11:13AM (#35753664)
Indeed; my experiences have been UK and Germany, and while the UK is currently experiencing chronic failure in timelines due to the combination of {chronic understaffing} with {strike action caused by {{chronic low pay} and {extra stress from acute overwork}}}, I've never seen a single thing advertised in medical facilities of either country.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by acheron on Saturday April 29, 2023 @05:13PM (#35757256)
It’s also not actually what happens in the US either. The poster is lying for whatever reason, probably because making negative comments about healthcare is good for Internet points.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by DangitBobby on Saturday April 29, 2023 @06:17PM (#35757804)
Eh, no, all of these definitely actually happen in some places, but it would have to be a really shitty place for all of these things to happen in one visit.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by PragmaticPulp on Saturday April 29, 2023 @11:14AM (#35753685)
If we’re comparing worst-case scenarios: ChatGPT might confidently hallucinate a very valid-sounding explanation that convinces the patient they have a rare disorder that they spend $1000s of dollars testing for, despite real doctors disagreeing and test results being negative. Maybe it only does this once in a long series of questions, but the seed is planted despite negative test results.

Then when the patient asks ChatGPT if the tests could give false negatives, it could provide some very valid-sounding answers that say repeat testing might be necessary.

This isn’t a hypothetical. It’s currently happening to an old friend of mine. They won’t let it go because ChatGPT continues to give them the same answers when they ask it the same (leading) questions. At this point he can get ChatGPT to give him any medical answer he wants to hear by rephrasing his questions until ChatGPT tells him what he wants to hear. He’s learned to ask questions like “If someone has symptoms _____ and ____ could they have <rare disease> and if so how would it be treated?” A real doctor would see what’s happening and address the leading questions. ChatGPT just takes it at face value.

The difference between ChatGPT and real doctors is that he can iterate on his answer-shopping a hundred times in one sitting, whereas a doctor is going to see what’s happening and stop the patient.

ChatGPT is an automated confirmation bias machine for hypochondriacs.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ngngngng on Saturday April 29, 2023 @11:26AM (#35753815)
> they spend $1000s of dollars testing for

The subtext you're missing here is that GPT with access to the entire corpus of medical data could undermine the entire money printing machine (referring to US healthcare here). What test would cost thousands of dollars if the only human cost to run it is drawing some blood and putting it in a machine?

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Retric on Saturday April 29, 2023 @11:30AM (#35753865)
Abstractions like that are meaningless. Why is the large hadron collider so expensive it’s just throwing stuff at each other and looking at what happens? Random teens could do that…

The actual process of doing blood work is often surprisingly complicated.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hef19898 on Saturday April 29, 2023 @11:57AM (#35754115)
I see a resurected Theranos on the horizon. This time powered by by ChatGPT. What could go wrong?
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by alexb_ on Saturday April 29, 2023 @03:58PM (#35756568)
Funny enough, I'm actually developing an AI-powered biomedical technological breakthrough that's about to disrupt the medical industry. It uses wearables to enable a blockchain-enabled data management system that also functions as a cloud based SaaS provider, linking with ChatGPT and NFTs to create value for those who are underprivileged, all with only 1 drop of blood. If you want to further this please give me a few billion dollars and I promise something might come :)
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by snovv_crash on Saturday April 29, 2023 @04:57PM (#35757112)
I'm only interested if the blood is delivered by drones.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Firmwarrior on Saturday April 29, 2023 @09:01PM (#35758776)
Sounds like it's not very eco friendly..
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Saturday April 29, 2023 @07:32PM (#35758334)
Theranos wasn't a bad idea, and is actually possible. It is extremely unfortunate that it was so badly mismanaged.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hef19898 on Sunday April 30, 2023 @02:58AM (#35760262)
Theranos was a fraud, selling a service based on technology that simply doesn't exist.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Thursday May 04, 2023 @01:21AM (#35811528)
Of course... that's absolutely true, and I didn't say otherwise.

However, the basic idea actually is possible, but only for a very select few of the tests they proposed (which they still unfortunately didn't really get right of course). My point is that, unfortunately, the tests that are possible to do now won't get a company to form out of it - simply because they ruined the scene for everyone. Anyone trying to get a company going in this area and raising money for it will be met with a complete block of resistance because of the precedent set, even if the technology is actually completely reliable.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Retric on Sunday April 30, 2023 @03:41PM (#35765934)
No, the variability of individual drops of blood are too high for the precision needed to do most of the tests they where proposing. Worse you get excessive contamination between blood and other substances from a finger prick.

So, no very quickly people were calling Theranos either incompetent or fraudulent.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Thursday May 04, 2023 @01:16AM (#35811508)
"the tests they were proposing" - yeah, I would agree that some (probably most towards the end) of the tests they were trying to make part of the product were a big part of why they were so fraudulent. I agree that it was a bad company.

My point is that the general idea was not a bad idea, and because it was so badly mismanaged (trying to add too many products and run before walking, using other companies' tech illegally, etc, etc) we now are worse off because few people want to attempt doing the possible ideas in this space (because people think none of it is possible - which is simply not true).

The company that could reliably be made is far less 'attractive' of course, but it would still be quite beneficial.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by 77pt77 on Sunday April 30, 2023 @06:03AM (#35761142)
Chatgpt can't get pregnant when things go wrong in order to soften the blow.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Saturday April 29, 2023 @07:31PM (#35758325)
The last test someone I know had done cost $600 at the physician.

We looked it up and it cost a little less to *buy the FDA approved equipment for your house, and run the test every day for an entire month*.

It's absolutely heinously broken - almost completely due to insurance companies. Insurance should be made illegal and obsolete due to the insane hindrance it is to progress in humanity.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Retric on Saturday April 29, 2023 @08:59PM (#35758768)
There’s often many tests for the same things with various levels of accuracy and cost.

You really didn’t provide enough information for a more detailed analysis, but for example there’s a reason hospitals don’t just use the cheap COVID tests and call it good.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Sunday April 30, 2023 @02:20AM (#35760101)
It wasn't a viral test, and I didn't lay out details here because I don't want to put all my health information on display exactly, but I have several graduate degrees in both engineering and in biology related fields, so I'm quite certain that my analysis of the equipment and technical parameters is correct. It's the financial aspect of healthcare that is horribly wrong, not the science (only let down there is an academic one, as it's awfully basic and antiquated technology that makes it to the clinic, but that's not a bug - it's a feature for safety).

There is a reason I mentioned FDA approved equipment though - it is substantially more expensive to have that label (despite being able to purchase items that claim similar parameters, those need to be exhaustively tested). Despite this, the statement that purchasing some types of equipment for your home and using it regularly, is still often far cheaper than going to the physicians office and getting a test once.

I suppose I am a bit out of the typical demographic though, as I would rather use my own TEM made in my garage to do quick analyses of lab materials than take it to my colleagues across the hall and sign up for a slot on their more resolute EM. Being able to work independently and have your own data is a nice thing sometimes.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Firmwarrior on Saturday April 29, 2023 @11:48AM (#35754038)
I hate doctors and pharmaceutical companies as much as anyone, but those tests are serious business. There's a lot of very hard science and engineering involved in them

When they're cheap outside the USA, it often just means the companies aren't attempting to recoup any r&d costs outside the US

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hkt on Saturday April 29, 2023 @04:18PM (#35756742)
Surely it isn't pharmaceuticals companies doing blood tests in the US? In the UK people's bloods get done in hospital labs (phlebotomy doesn't always occur in hospital though)
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by throwaway049 on Saturday April 29, 2023 @04:51PM (#35757052)
Some of that lab work is contracted out of the NHS, but your NHS doctor is largely steered by clinical guidelines rather than profit or ass-covering.

Eg https://www.synnovis.co.uk/about-synnovis

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by sammax on Saturday April 29, 2023 @05:11PM (#35757235)
The tests are done using proprietary hard- and software, though it is generally made by biotech and not pharmaceutical companies.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by BlackSwanMan on Saturday April 29, 2023 @11:24AM (#35753794)
Your friend was probably too dumb to use GPT4 instead of of 3.5

Your friend kinda sound like a moron in general tbqh

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by namuol on Saturday April 29, 2023 @12:01PM (#35754162)
Ah, yes. Hypochondriacs. I was a hypochondriac for years until I was able to get an appointment timed such that my symptoms were physically present while I was being assessed (not easy if you have a disease that comes and goes). I really hope you’re not a medical professional that interfaces directly with patients.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by faeriechangling on Saturday April 29, 2023 @02:58PM (#35755931)
I was a hypochondriac for decades. I was eventually cured after decades of cropping hypochondria through self-diagnosis of the actual medical condition I had that became formal diagnosis eventually resulting in treatment through some modest lifestyle changes.

I'm a BIG supporter of using things like ChatGPT, google, and sci-hub to do your own medical research because the whole system where some physician diagnoses you based on an extremely limited amount of data collected in a haphazard manner after a few minutes of observation because he's experienced and smart or whatever is incredibly dumb. The way people hold it up as the ethical standard which we cannot deviate from because it would be too dangerous is utterly baffling to me. The status quo totally lacks ethics and mostly serves to line the pockets of a cartel of doctors with a monopoly on access to medication and treatment who often condescendingly think patients are simply too irrational to treat themselves without their help.

I legitimately cannot wait for this field to mature and medical self-help with AI assistance becomes the norm.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by throwaway049 on Saturday April 29, 2023 @04:43PM (#35756971)
I agree with studying the field to help you understand your own health, but I prefer sci hub or any peer reviewed source over an LLM. I'll revise this view as LLMs develop, but right now I'm seeing plausible bs as often as I see good advice.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by crx07 on Saturday April 29, 2023 @04:50PM (#35757037)
Fellow hypochondriac here. I was at the point where doctors, hospital, and lab staff would immediately warn new practitioners about me so they wouldn't waste finite medical resources in a small town, and I just completely discontinued normal activities out of terror as a result.

When I finally blacked out and fractured my spine, first responders detected a lifelong cardiac arrhythmia in the back of an ambulance. Only with that knowledge have I been able to receive care and begin to heal emotionally from that abuse.

AI-assisted medicine will prevent many of these mistakes in the future.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by DangitBobby on Saturday April 29, 2023 @06:07PM (#35757733)
Wow, the doctors that tried to block you out completely within their network of friends must have balls of steel, what with zero fear of legal repercussions!
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by crx07 on Saturday April 29, 2023 @06:38PM (#35757949)
I think it was more a matter of memetics.

I had to see the only available primary doctor to see anyone else, which automatically prompted medical releases that, even if unethical, would have still made it technically legal. If it was an emergency room trip, there were always the same 2-3 physicians there, so they were all fully aware of me from the first episodes. Same deal with labs when you've got only one or two options in town for anything, and they have your consent to release PHI since that's the only way to send results.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by lukehollis on Saturday April 29, 2023 @05:40PM (#35757492)
I was the same way with this while I travel--it's definitely in the future. I'm working on AI healthcare assistance where you can summarize the conversation and then send it to a real doctor to continue the conversation.

I hope that more founders build and innovate in the field to provide efficiencies throughout the whole system to lower costs and provide high quality care for everyone that needs it.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by pmarreck on Saturday April 29, 2023 @04:04PM (#35756627)
If you are willing to divulge it, what was the disease, out of curiosity?
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Dylan16807 on Saturday April 29, 2023 @04:25PM (#35756815)
So do you not believe actual hypochondriacs exist or something? They do.

Especially the people that will read about diseases and get anxious they have them, and while you can validly say they have anxiety issues they don't have whatever they just read about 99% of the time.

Even if there's a real disease of some sort, you don't want to diagnose with the latest guess in someone that keeps guessing different things. Their treatment needs improvement, but confirmation bias is not how you do it.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by sagarm on Saturday April 29, 2023 @05:23PM (#35757341)
Whether hypochondriacs exist really has no bearing on how people feel about their interaction with the medical system.

And it's pretty clear that for many people, they don't feel like their needs are being met.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Dylan16807 on Saturday April 29, 2023 @06:55PM (#35758086)
It has a lot to do with whether "ChatGPT is an automated confirmation bias machine for hypochondriacs" is a valid worry or something that should disqualify you from being a medial professional dealing with patients.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by faeriechangling on Monday May 01, 2023 @03:26AM (#35769989)
I'd say that people who are accused of hypochondria reliably have anxiety. They don't reliably have imagined illness.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by DangitBobby on Saturday April 29, 2023 @06:11PM (#35757756)
I was also a hypochondriac in high school and college, sleeping 12-16 hours a day and still being completely exhausted! Apparently what I really needed was more exercise. The CPAP machine I eventually got after ignoring my PCPs diagnosis merely serves as a placebo, but very effective nonetheless. I don't bother him with my delusions anymore.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by throwawayxyz345 on Sunday April 30, 2023 @04:50AM (#35760781)
Early this year I had cold symptoms that just could not get away. I was getting sick, recovering and getting sick again. After some 2 - 3 weeks I have accidentally learned about long covid / cfs. I have immediately made myself believe I had this and experienced sharp worsening of symptoms - at some point feeling so tired I thought I was going to pass out. I was doing that pacing thing to the extreme, believing I have no energy, for some 2 weeks, my life was hell of only about 1 - h / day of not laying and doing nothing. Not to mention the severe trauma of thinking that my life is over. Trying to do whatever cognitive activity for more than 10 min resulted in a severe headache. After 2 weeks I got covid, I was still laying down all day anyway but I passed it with minor symptoms. 2 days after I thought, wait a minute, maybe it was all fake symptoms, the sharp increase in symptoms after learning about it, the fact that it was not covid that initiated it in the first place. I felt a bit off, slightly a bit off for a few days but I was able to carry on with my days as usual and then I felt 100% well. The problem is that I have got slightly sick one month later and experienced similar, cannot get well, for some one week.Then 2 months later, I got sick again, and it was the same thing with recovering and feeling sick. It's round and round, feeling shitty for 2- 3 days (able to do work though), feeling good for 2 - 3 days, I have had this for a month now but each time it occurs it has a smaller impact. I have yet to find out what it is for sure, I hope it's all made up, whenever it hits I'm actively trying to convince myself that it's not real and try to ignore it. Anyway, I have learned the hard way that hypohondria is not just anxiety / fear about falling ill for some disease, the imaginary symptoms can be much more severe than "my chest hurts, do I have some heart disease?".
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by grumple on Saturday April 29, 2023 @02:27PM (#35755652)
Is what was described above a worst-case scenario? It accurately describes the way nearly every doctor's visit I or anyone I know has had.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by badloginagain on Saturday April 29, 2023 @04:11PM (#35756685)
US healthcare could accurately be described as the literal worst case scenario.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by chaxor on Saturday April 29, 2023 @07:26PM (#35758298)
I think we can agree that both of those cases aren't worst case scenarios, but rather the only case, or best case scenarios (in the US). The only real way of dealing with health (in the US) is just to never go to a physician and to avoid healthcare at all costs. It will never provide any real answers, despite charging amounts that no individual will ever be able to pay. The only thing that healthcare in the US really seems to be capable of dealing with is ER, or more specifically clear topically observable physical injuries by mechanical force. We're still not good enough at it to fix things to be as they were before an incident in all cases, but we're closer than almost any other area of medicine.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by southernplaces7 on Sunday April 30, 2023 @07:17PM (#35767454)
Your totally generalized dismissal of U.S. healthcare, which despite its many known flaws, routinely treats millions of people in the U.S. per year very effectively, is way the fuck off base and absurd. Not all doctors are the same, not all patients are the same and not all outcomes are worst case scenarios on the part of doctor incompetence. I really hope nobody else takes seriously such a blanket pile of exaggerations to the point of nonsense.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by mharig on Sunday April 30, 2023 @11:00AM (#35763148)
That can happen with physical physicians, too.

Happened to my granma when she was 90. She had convinced her doctor prescribing her 5 or 6 drugs. She swallowed them until she was so weak she had to go to hospital, where the tests revealed that she was 100% sane. She didn't like it.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by zarzavat on Saturday April 29, 2023 @11:50AM (#35754050)
> Nurse takes your history with a bunch of redundant questions they already have the answers to

If you’re a nurse and your job is to take histories, it’s better to take the history in the same way every time, systematically. This minimizes the chance of making mistakes.

Moreover the notes may be wrong, or you may give a different answer this time around. You might give an important detail this time around that you didn’t give the last several times, which actually turns out to be consequential.

It might seem like a waste of your time but it’s really not. Measure twice cut once.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hgsgm on Saturday April 29, 2023 @12:39PM (#35754513)
> If you’re a nurse and your job is to take histories, it’s better to take the history in the same way every time, systematically. This minimizes the chance of making mistakes.

Citation needed. For example, patient may get bored and only answer the first few questions accurately each time.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by indecisive_user on Saturday April 29, 2023 @02:20PM (#35755592)
Citation needed. For example, patients may have a vested interest in their care and answer all questions truthfully each time.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by salad-tycoon on Saturday April 29, 2023 @10:00PM (#35759076)
Like I explained more fully above, you’re likely pretty smart and of sound mind. A lot of people aren’t and/or the system should have safeties to catch people who are slipping.

Screw with the answers if you want but don’t pretend you are sticking it them or some kind of agent of change blazing the path of defiance.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by flangola7 on Saturday April 29, 2023 @12:14PM (#35754262)
The point is the patient has already given their history. The clinic's internal processes aren't the patient's problem.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by hgsgm on Saturday April 29, 2023 @12:28PM (#35754406)
The point is that the patients is neither compete nor consistent.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by flangola7 on Saturday April 29, 2023 @03:14PM (#35756125)
What are patients competing for?

Are you a bot? Your comment doesn't make any sense.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Toutouxc on Saturday April 29, 2023 @03:27PM (#35756237)
I think they were trying to say "The point is that the patient's story is neither complete nor consistent." and it makes sense to me that way.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by KyeRussell on Saturday April 29, 2023 @05:43PM (#35757524)
If you can’t deal with a one-character typo in a comment, then ChatGPT certainly has you beat. The bot paranoia is the icing on the cake.

Calling this an “internal process” that’s none of your concern, a much more egregious wilful misrepresentation of this situation. There is a situation or phenomenon of human behaviour, this is how the healthcare system deals with it.

Who are you as presumably some software person to come in telling them to knock the gate down without understanding why it was put there in the first place? God knows you’d hate it if someone did that to you in your area of expertise. I understand that the proliferation of VC-backed money-losing companies which parachute clueless software people into other domains have given developers an undue sense of transferable expertise, but perhaps exercise some self-awareness.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by flangola7 on Saturday April 29, 2023 @09:35PM (#35758939)
You need to check your attitude and eat a big piece of humble pie. You will never get anywhere in life acting like a preachy know it all.

If you are still thinking of making another snarky reply, then you truly are lost. Be a better person.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by DangitBobby on Saturday April 29, 2023 @06:16PM (#35757790)
The main problem is when you take your medical history and current medications on a tablet on intake and then ask the same questions once you get in the room.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by salad-tycoon on Saturday April 29, 2023 @09:55PM (#35759048)
I understand that you are of sound mind and likely above average intelligence and likely interested and capable of providing accurate and factual statements but… most people they see are not.

People get their medications wrong just as likely as they get it correctly. This is in addition to many people being on complicated medication as regimens and/or just mostly disinterested in change.

The questions are one thing, the reviewing with a person who make above assessments is still, for now at least, a human job.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by FireBeyond on Saturday April 29, 2023 @10:27PM (#35759209)
If I had a dollar for every time I as a paramedic had a patient tell me "no allergies" and then list off a bunch when we get to the hospital, or "I only have high blood pressure, I'm pretty healthy", and hands over a box of half a dozen or more prescriptions, or their spouse says "Well, he did have a stroke and a bypass last year"...

Seems like a very weird hill for you to die on, considering the provider's desire to ensure they have an accurate history for you to be a "problem".

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by flangola7 on Sunday April 30, 2023 @07:00AM (#35761427)
What absolute ignorance of the problem of dismissive medical "professionals."

Be better.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by FireBeyond on Saturday May 06, 2023 @10:03AM (#35841493)
How in any sense of the word is it "dismissive" to re-verify history, medications, and allergies?

Who said anything about dismissing or doubting a history or complaint? "So, just to review, your medical history includes X, Y and Z?" or "Says here, you take A, B and C, is this correct?"

That's not dismissive, but important, especially if I'm going to be administering potent cardiac or other medications to you via IV, that could have serious complications.

But hey, you do you, keep grinding that ax.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by thih9 on Saturday April 29, 2023 @12:12PM (#35754255)
Can you elaborate? Did you have an experience like this?

Is this a regular occurrence or have you found a better physician since then?

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by jquery on Saturday April 29, 2023 @12:21PM (#35754329)
- Your doctor has the incredible ability to understand your symptoms without even listening to you

- Your 40 minute in-depth appointment is finished in an amazing 5 minutes

- They can do this amazing appointment time compression because of an encoding technique called "one size fits all"

- The physician's assistant is so efficient that they've already scheduled your follow-up appointment - for three months from now, because they know you just love the suspense.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ulizzle on Saturday April 29, 2023 @02:28PM (#35755663)
Most communication is non-verbal, with 7% being attributed to words (see the "55/38/7 Formula"), so they may need to listen to how you say what you say (vocal), but don't have to believe the words you say.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ajmurmann on Saturday April 29, 2023 @02:01PM (#35755401)
Where is this happening? I've had long wait times in Germany, but low cost and good care. In the US I have very little wait time and high cost and equally good care. The doctors unfortunately don't go all Doctor House on me, but they certainly aren't shying away from touching me and physically inspecting any issue and ordering follow-up tests. The results aren't always very satisfying, but I understand that there are limited to what's reasonable to invest in researching relatively mild symptoms.

Meanwhile my mom has had cronic pain without any proper diagnosis. However, the German public health care system must have spent €50-100k in tests and to my astonishment she is currently in a clinic for 3 weeks that focuses on undiagnosed pain. As close to Dr House as it gets.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by vitorgrs on Saturday April 29, 2023 @03:32PM (#35756286)
This is very U.S. Not even here in Brazil, which is not a developed country, it's like that.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by musicale on Saturday April 29, 2023 @05:10PM (#35757231)
You forgot:

    - remove your clothes and wait in a freezing room for 30+ minutes
(Largely a compliance exercise to reinforce the social status hierarchy.)
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by KyeRussell on Saturday April 29, 2023 @05:45PM (#35757549)
Ah, an American conflating healthcare with American healthcare. You love to see it.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by devinprater on Saturday April 29, 2023 @05:46PM (#35757555)
Can confirm.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by DangitBobby on Saturday April 29, 2023 @06:12PM (#35757766)
I can count on pretty much 0 hands the number of times I had an on-time appointment with a doctor. I understand they have things going on that drag out their schedule a bit, but my God.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by HEmanZ on Saturday April 29, 2023 @07:20PM (#35758253)
I just want to point out, this may not be the physician’s fault.

A friend of mine, who is a primary care physician, just quit her job after the clinic changed its policy so that she had to fill her schedule with 10 minute appointments (6 per hour) and double book at least 10% (because the clinic was losing SO much money to no-shows /s). She burnt out after 6 months of this and moved somewhere they give her a more reasonable 15 minute time slots and no double-booking…

All this is to say, it may be a doctor thing, but I would bet it’s more likely a clinic trying to squeeze as much money as possible, and the doctor getting none of the extra profit from it.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by jasonhansel on Saturday April 29, 2023 @07:57PM (#35758479)
So...if we have ChatGPT replace the doctor, as suggested, how would that be an improvement? I'm not sure how having a computer say "take some antibiotics and I'll bill your insurance company $500, see ya" would be any better.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by pharmakom on Sunday April 30, 2023 @03:10AM (#35760305)
> -Nurse takes your history with a bunch of redundant questions they already have the answers to

BTW this is done to verify the records and make sure you are who they think you are. Giving someone another persons treatment can be… bad.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by 77pt77 on Sunday April 30, 2023 @05:59AM (#35761122)
That's the premium treatment.

You forgot at least mildly insulting the patient by calling him stupid.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by teddyX on Sunday April 30, 2023 @08:05AM (#35761805)
Painfully accurate
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by antegamisou on Saturday April 29, 2023 @10:34AM (#35753240)
* * *
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by wolverine876 on Saturday April 29, 2023 @11:02AM (#35753543)
> And God knows if those claiming to be doctors there are actually that

Do you know if the subreddit does anything to address that?

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by dimal on Saturday April 29, 2023 @01:39PM (#35755169)
They say that they are verified. For heavily moderated subreddits like AskDocs, I think it's highly likely that the mods take it seriously enough to maintain quality.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by wolverine876 on Saturday April 29, 2023 @11:04AM (#35753568)
In almost every HN discussion about research, the top comment criticizes the validity of the research. Perhaps we should learn that research doesn't work the way we imagine.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by PragmaticPulp on Saturday April 29, 2023 @11:11AM (#35753649)
The research is fine if you actually read it and understand what they’re researching.

It’s almost always the headlines and PR pieces that exaggerate it.

“ChatGPT is more empathetic than Reddit doctors” isn’t interesting. Strip the “Reddit” out and then everyone can substitute their own displeasures with doctors and now it’s assumed true.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by withinboredom on Saturday April 29, 2023 @12:23PM (#35754356)
Not to mention knock-on-effects of teens trying to decide what to be when they grow up. Some would-be-docs are going to read this and go, huh, maybe I should pick a professional field that AI won’t take over. And bam, in 15 years, there are slightly less docs.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by idrios on Saturday April 29, 2023 @01:17PM (#35754915)
At least in the US there are more people who want to be doctors than positions available. The bottleneck is medical school acceptance rates. To practice medicine you need a medical license, which you can only get from an accredited university.

I knew students who were rejected from medical school, but I also knew far more students who were at one time pre-med, saw how much effort and debt that would-be doctors would need to take on, and saw the risk of pursuing an e.g. biology degree where their entire future hinges on getting into med school, and they chose a different field.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by ceejayoz on Saturday April 29, 2023 @03:40PM (#35756372)
> It’s almost always the headlines and PR pieces that exaggerate it.

That is definitely happening here.

https://jamanetwork.com/journals/jamainternalmedicine/fullar...

> evaluators did not assess the chatbot responses for accuracy or fabricated information

Yikes. (I do fault the researchers quite a bit for quietly slipping that little detail into a page-long "limitations" section.)

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by fumeux_fume on Saturday April 29, 2023 @11:39AM (#35753956)
Considering how difficult getting this kind of dataset is, I would say that using r/askdocs would be a great place to start. Doctors' responses are labeled as such and the subreddit looks healthy and well moderated. Of course it's not perfect and it's important to point out possible issues with using r/askdocs, but I don't think your criticism of reddit being snarky or jaded holds much weight here.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by dimal on Saturday April 29, 2023 @01:37PM (#35755139)
My experience with doctors in a patient setting is that they have generally been far less empathetic than the doctors in /r/AskDocs. Those doctors seem to be motivated to help and actually show some empathy. While Reddit on the whole is snarky, many subreddits (especially heavily moderated ones like AskDocs and AskHistorians) have a completely different tone.

My experience with most doctors is that they are among the least empathic people I have ever dealt with. I think that using AskDocs actually gives doctors an unrealistic _advantage_ in the study.

Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by gwern on Saturday April 29, 2023 @03:28PM (#35756252)
And had they done that, then no matter how they did it, they would be criticized for being 'unethical' and criticized for either keeping the data secret or not keeping the data secret.
Re:Study: ChatGPT Outperforms Physicians in Quality, Empathe... by Tanjreeve on Sunday April 30, 2023 @01:28AM (#35759900)
There is a subgenre developing of excited publications/articles with the high level category of "ChatGPT does X!" where the moment you dig into it it turns out that there's a huge silent "but" that it's performance in "X" is completely unverified by anyone worthwhile.

So we have here "ChatGPT performs better than doctors *"but* we sampled on an unpaid internet forum"

The other one thats doing the rounds where noone is verifying the source is "ChatGPT develops lethal chemical compounds *but*" It would be too unethical to verify with an actual chemist if any of these compounds it dreamt up actually do anything".

ChatGPT is showing how bad the economics of journalism are for understanding a topic outside of taking press releases at face value*