News for hackers. Stuff that matters.
Re:The Bitter Lesson is coming for Tokenization by lukan on Wednesday June 25, 2025 @01:14PM (#44379674)
I don't think it is quantity that matters. Otherwise supercomputers are smart by definition.
Re:The Bitter Lesson is coming for Tokenization by mgraczyk on Wednesday June 25, 2025 @01:19PM (#44379719)
Well no, that's not what anyone is saying.

The claim was that it isn't possible in principle for "DAGs" or "immutable architectures" to be intelligent. That statement is confusing some theoretical results that aren't applicable to how LLMs work (output context is mutation).

I'm not claiming that compute makes the m intelligent. I'm pointing out that it is certainly possible, and at that level of compute it should be plausible. Feel free to share any theoretical results you think demonstrate the impossibility of "DAG" intelligence and are applicable

Re:The Bitter Lesson is coming for Tokenization by lukan on Thursday June 26, 2025 @04:03AM (#44385233)
I am not saying it is impossible, I am saying it might be possible, but far from plausible with the current approach of LLMs in my experience with them.