Re:A ChatGPT mistake cost us $10k
by zeroonetwothree on Sunday June 09, 2024 @08:57PM
(#40628999)
There’s a difference between not knowing what you are doing and making a mistake.
Re:A ChatGPT mistake cost us $10k
by throw46365 on Sunday June 09, 2024 @09:06PM
(#40629067)
The "zen" of LLMs is that they do not see a real distinction between these two things, or either of these two things and success ;-)
Re:A ChatGPT mistake cost us $10k
by PhasmaFelis on Sunday June 09, 2024 @09:03PM
(#40629046)
An awful lot of mistakes are made because one didn't know something that would have enabled one to avoid it. Not knowing what you don't know is difficult to work around.
Re:A ChatGPT mistake cost us $10k
by throw46365 on Sunday June 09, 2024 @09:03PM
(#40629048)
I dunno. I tend to annoy people when taking on jobs by telling people what I am concerned about and do not understand, and then sharing with them the extent to which I have managed to allay my own concerns through research.
I turn down a lot of jobs I don't feel confident with; maybe more than I should.
An LLM never will.
In my experience, hardly anyone in software does know what they're doing, for sufficiently rigorous values of "know what you're doing." We all read about other people's stupid mistakes, and think "haha, I would never have done that, because I know about XYZ!" And then we go off and happily make some equally stupid mistake because we don't know about ABC.