Re:Medical chatbot using OpenAI’s GPT-3 told a fake patient ...
by wizzwizz4 on Friday February 26, 2021 @06:42PM
(#26281177)
They're doing what you tell them to, not what you want them to. Same with GPT-3; it's predicting what (from its experience) it thinks a human would say, not what is ethical to say.
But it does illustrates how it's easy to get trapped into a local minima.