News for hackers. Stuff that matters.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by zozbot234 on Thursday January 26, 2023 @02:35PM (#34537506)
But ChatGPT does not use brute force search to look for an answer. It interpolates among the answers in its training set. I.e. in Yann LeCun's analogy of a cake, interpolation or unsupervised learning is the cake; direct feedback on each single data point or supervised learning is the icing on the cake; and general feedback of the "how I am doing" sort or reinforcement learning is the cherry on top. Now Yann LeCun is just saying that the cake is a lie, and leaving it at that. I don't think this is a helpful understanding.
Re:Yann LeCun: ChatGPT is 'not particularly innovative' by visarga on Thursday January 26, 2023 @03:06PM (#34537973)
He is saying "chatGPT is mostly cake and cake wasn't invented here".