Re:Oceania Always at War with Eastasia: Generative AI and Kn...
by remexre on Thursday March 02, 2023 @02:56PM
(#35001063)
The probability that the broken clock is right is straightforwardly 2/1440 = 0.001 = 0.1%, innit?
[ Parent
| on HN ]
Re:Oceania Always at War with Eastasia: Generative AI and Kn...
by williamcotton on Thursday March 02, 2023 @03:00PM
(#35001122)
To the second? To the millisecond? What are we wanting here? You're missing the point.
But I'll play this silly game: ChatGPT is not incorrect 99.9% of the time.
Re:Oceania Always at War with Eastasia: Generative AI and Kn...
by mrtranscendence on Thursday March 02, 2023 @03:18PM
(#35001381)
Nor is it only incorrect one billionth of the time, as you seem to be indicating through your hypotheticals. Depending on what I've asked it about, it can be incorrect at an extremely high rate.
Re:Oceania Always at War with Eastasia: Generative AI and Kn...
by williamcotton on Thursday March 02, 2023 @03:23PM
(#35001462)
That is definitely not what I am indicating. I'm pointing out the absurdity of speaking of probabilistic things in absolutes.
Yes, ask an LLM to multiply a few numbers together and you will get around 100% failure rate.
The same goes for quotes, citations, website addresses, and most numerical facts.
The failures are predictable. That means the models can be augmented with external knowledge, Python or JS interpreters, etc.
Re:Oceania Always at War with Eastasia: Generative AI and Kn...
by slackdog on Thursday March 02, 2023 @03:52PM
(#35001895)
Clock correctness is relative. If the antique windup clock in your living room is off by 5 minutes, it's still basically right. But if the clock in your smartphone is 5 minutes off, something has clearly gone wrong.