News for hackers. Stuff that matters.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by idiotsecant on Wednesday October 30, 2024 @09:00PM (#42002340)
LLMs are a local maximum in the same way that ball bearings can't fly. LLM-like engines will almost certainly be components of an eventual agi-level machine.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by FuckButtons on Wednesday October 30, 2024 @09:47PM (#42002605)
I don’t think that’s necessarily true, that presumes that the cobbled together assortment of machine learning algorithms we have now will somehow get agi, if we need a fundamentally different way of doing things there’s no reason to assume it will use a language model at all.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by TZubiri on Wednesday October 30, 2024 @09:39PM (#42002565)
I agree, my bet is that they will be used for NLP, and ML debugging/analysis.
Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by lucianbr on Thursday October 31, 2024 @01:04PM (#42008815)
What is your "almost certainty" based on? What does it even mean? Every thread on LLMs is full of people insisting their beliefs are certainties.

What I'm certain is we should not praise the inventor of ball bearings for inventing flight, nor once ball bearings were invented flight became unavoidable and only a matter of time.

Re:Chain-of-Thought Can Hurt Performance on Tasks Where Thin... by idiotsecant on Saturday November 09, 2024 @06:02PM (#42097468)
I say 'almost certainly' because LLMs are basically just a way to break down language into it's component ideas. Any AGI level machine will most certainly be capable of swapping sematic 'interfaces' at will, and something like an LLM is a very convenient way to encode that interface.