> The same is true with LLM solutions that don't work 100% of the time.
Also in my experience, having my colleagues do root cause analysis (RCA) with LLM brings to me invalid RCAs which I have to rule out, instead of working on finding true RCA.
I saw part of documentary about Charlie Abrahams, son of Jim Abrahams. Charlie had epileptic seizures as a child, hundredths a day. In the documentary, Charlie's doctor said that no drug in his experience worked as fast as ketogenic diet (seizures stopped in three days) and as reliably as ketogenic diet (works on more than 80% of people). When he was asked why he did not applied ketogenic diet, he said there still were drug options to try.
"Medicines do not work 100% of time," my bald cranium.
You don't have to do this? Maybe someone is making you, but it's literally possible to just stop using LLMs for purposes where they fail reliably.
I'm also not sure what the point of the keto story is. Are you saying the Polio Vaccine does not work?
> I'm also not sure what the point of the keto story is.
The situation was much like we have with LLMs. "It does not work" - "You are using an inferior thing, here are more advanced."
What is the cost of these not fully 100% working things?
I think most people will come around to this way of thinking once the pro-LLMers stop pretending like the statistics don't exist too (i.e. that ML is the solution to any problem, despite how unreliable it is).