News for hackers. Stuff that matters.
Re:LLMs can't perform "genuine logical reasoning," Apple res... by namaria on Tuesday October 15, 2024 @06:02AM (#41846903)
LLMs are not simulating brains in any capacity. The words 'neural network' shouldn't be taken at face value. A single human neuron can take quite a few 'neurons' and layers to simulate as a 'neural network'.
Re:LLMs can't perform "genuine logical reasoning," Apple res... by carlmr on Tuesday October 15, 2024 @09:42AM (#41848524)
Sure, but the basic idea of firing neurons is there, and the connection of these "neurons" to a neural network like an LLM does not allow the network to perform computations directly.

The level of detail of the simulation has little bearing on this. And in fact whether you call it a simulation or something else doesn't matter either. Understanding that the LLM does not compute by using the CPU or GPU directly is what's necessary to understand why computation is hard for LLMs.