News for hackers. Stuff that matters.
Re:Does current AI represent a dead end? by jandrese on Friday December 27, 2024 @08:36PM (#42527785)
That's just tweaking the constants on the compression algorithm.
Re:Does current AI represent a dead end? by red75prime on Saturday December 28, 2024 @02:35AM (#42529295)
If you think that "compression" somehow means "non-intelligent", consider this:

The best compression of data that is theoretically achievable (see Kolmogorov complexity) is an algorithm that approximates process that produces the data. And which process produces texts on the internet? Activity of the human brain. (I described it a bit sloppily. We are dealing with probability distribution of the data, not the data itself. But the general idea still holds.)

Using chain-of-thought removes the constraint that the output of the resultant algorithm should use fixed amount of compute per token.