News for hackers. Stuff that matters.
Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by eghad on Friday February 26, 2021 @09:19PM (#26282085)
I mean the OpenAI team would never approve this application for production. It's very clearly stated (in both the article and use case guidelines) that medical diagnosis would be a "high stakes domain" and is unsupported. Frankly, I'm not sure why this result is even notable.
Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by joe_the_user on Friday February 26, 2021 @10:03PM (#26282227)
If you say OpenAI will only approve applications for "zero stakes", domains, then you are saying what the parent is saying - it's entirely for entertainment.

If you claim there's some "low but not zero" stakes application, I'd like to know what that is. I mean, it seems clear that if someone asks a GTP-3 customer service bot "so what should I do now", there's a reasonable probability that the bot would say "throw your product in the garbage and buy [competitor X]", since you can find that commentary on the Internet (true or not). That's not a life and death event but whatever stakes you have in that bot, it's thrown them away.

Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by eghad on Saturday February 27, 2021 @12:01AM (#26282777)
I never said zero stakes? There are clear instances where a a 1 or 0 shot transformer can have benefits beyond entertainment--topic modeling and named entity recognition for instance (I'm on the team that believes that human-in-the-loop systems will always outperform solo systems on their own and that GPT-3 alone does not confer any competitive advantage). If you think that chatbots are the only user facing use-case for a transformer, then frankly that's on you falling for the hype surrounding its language generation performance.

OpenAI knows GPT-3 is not sophisticated enough to perform medical diagnosis or analysis (anyone can look at how Watson failed), so it'd never approve such a risky application.

Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by peterwoerner on Friday February 26, 2021 @11:16PM (#26282524)
I would saw that copy.ai is a low but not zero stakes application. It develops a draft of copy for ads, landing pages etc. which you can review before taking live.
Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by joe_the_user on Saturday February 27, 2021 @03:47PM (#26288002)
Sure, I can see "low stakes plus human review" sounds doable but not that much a evolute from "no stakes".
Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by Barrin92 on Saturday February 27, 2021 @04:55AM (#26283793)
>I'm not sure why this result is even notable.

because probably in due time when building a model of that size becomes slightly more affordable someone with the 'move fast and break things' mentality will peddle a bot like this to customers and we'll find ourselves in a situation where this actually happens to a real person.

Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by a3n on Friday February 26, 2021 @10:27PM (#26282334)
Doctors can prescribe medicines "off label," using a medicine for a condition that it was not developed or approved for.

So why not this?

Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ... by eghad on Saturday February 27, 2021 @12:05AM (#26282793)
Because the manufacturer of the medicine explicitly said it can't treat the off-label use? And won't sell it to anyone claiming it can.