Re:How large are large language models? (2025)
by goatlover on Wednesday July 02, 2025 @11:35AM
(#44445011)
How well does that apply to robotics or animal intelligence? Manipulating the real world is more fundamental to human intelligence than compressing text.
[ Parent
| on HN ]
Re:How large are large language models? (2025)
by ToValueFunfetti on Wednesday July 02, 2025 @12:11PM
(#44445464)
Under the predictive coding model (and I'm sure some others), animal intelligence is also compression. The idea is that the early layers of the brain minimize how surprising incoming sensory signals are, so the later layers only have to work with truly entropic signal. But it has non-compression-based intelligence within those more abstract layers.
Re:How large are large language models? (2025)
by goatlover on Wednesday July 02, 2025 @03:51PM
(#44448055)
I just wonder if neuroscientists use that kind of model.
Re:How large are large language models? (2025)
by ToValueFunfetti on Wednesday July 02, 2025 @07:09PM
(#44449784)
I doubt there's any consensus on one model, but it's certainly true that many neuroscientists are using the predictive coding at least some of the time
https://scholar.google.com/scholar?hl=en&as_sdt=0%2C36&q=pre...