News for hackers. Stuff that matters.
Re:Peak LLM by soneca on Sunday April 16, 2023 @02:46PM (#35593062)
> ”if we will ever get there.”

What do you mean with this? There might never be a peak for something?

It doesn’t make much sense to me, so I read it as a flag that your position is more faith-based (or “hope-based” for a less loaded word) than fact-based. I could be wrong in this interpretation of course, so the initial question in my comment is a genuine one.

Re:Peak LLM by Taek on Sunday April 16, 2023 @02:52PM (#35593120)
It means LLMs might self-improve beyond the point where we can comprehend how intelligent they are. An LLM with 10x the capabilities of all human brains combined is indistinguishable to a human with one that has 100x the capabilities of all humanity combined, effectively making it possible for there to be "no peak"
Re:Peak LLM by ihatepython on Monday April 17, 2023 @05:41AM (#35598567)
I don't think you understand how LLMs work
Re:Peak LLM by Taek on Monday April 17, 2023 @07:18PM (#35607926)
I think you underestimate how intelligent LLMs are. If the training data only explains a certain concept in French, the LLM will nonetheless be able to tell you about that concept in any other language it has proficiency in. There's clearly a lot more going on under the hood than just a sophisticated markov chain.