News for hackers. Stuff that matters.

A comment on 91% of ML Models Degrade over Time. Parent comment

Re:91% of ML Models Degrade over Time by illegalmemory on Friday April 14, 2023 @04:06AM (#35566801)
> ChatPGT could very well stumble upon an obscure connection between two words that is improbable for humans to make

But is there any guarantee that ChatGPT will consistently arrive at same results over and over ?

[ Parent | on HN ]
Re:91% of ML Models Degrade over Time by parineum on Friday April 14, 2023 @04:11AM (#35566829)
What would that be a test/condition for?
[ Parent | on HN ]
Re:91% of ML Models Degrade over Time by cowl on Friday April 14, 2023 @04:47AM (#35567079)
No, and that's why I also say that it has not "learned" or "reasoned". it may very well make a connection between A and B and miss the same type of connection between C and D. or also miss the same A - B connection in the presence of other variables F,G,H. So the LLM cannot guarantee the generalization of the problem although it may solve a particular instance of that problem.
[ Parent | on HN ]