Re:Yann LeCun: ChatGPT is 'not particularly innovative'
by zozbot234 on Thursday January 26, 2023 @02:35PM
(#34537506)
But ChatGPT does not use brute force search to look for an answer. It interpolates among the answers in its training set. I.e. in Yann LeCun's analogy of a cake, interpolation or unsupervised learning is the cake; direct feedback on each single data point or supervised learning is the icing on the cake; and general feedback of the "how I am doing" sort or reinforcement learning is the cherry on top. Now Yann LeCun is just saying that the cake is a lie, and leaving it at that. I don't think this is a helpful understanding.
[ Parent
| on HN ]