News for hackers. Stuff that matters.
Re:Does current AI represent a dead end? by legacynl on Friday December 27, 2024 @01:23PM (#42524594)
I don't really get where you're coming from..

Is your point that the capabilities of these models have grown such that 'merely' calling it a neural network doesn't fit the capabilities?

Or is your point that these models are called neural networks even though biological neural networks are much more complex and so we should use a different term to differentiate the simulated from the biological ?

Re:Does current AI represent a dead end? by joe_the_user on Friday December 27, 2024 @01:30PM (#42524659)
The OP is comparing the "neuron count" of an LLM to the neuron count of animals and humans. This comparison is clearly flawed. Even you step back and say "well, the units might not be the same but LLMs are getting more complex so pretty soon they'll be like animals". Yes, LLMs are complex and have gained more behaviors through size and increased training regimes but if you realize these structure aren't like brains, there's no argument here that they will soon reach to qualities of brains.
Re:Does current AI represent a dead end? by cs702 on Friday December 27, 2024 @01:39PM (#42524739)
Actually, I'm comparing the "neuron-neuron connection count," while admitting that the comparison is not apples-to-apples.

This kind of comparison isn't a new idea. I think Hans Moravec[a] was the first to start making these kinds of machine-to-organic-brain comparisons, back in the 1990's, using "millions of instructions per second" (MIPS) and "megabytes of storage" as his units.

You can read Moravec's reasoning and predictions here:

https://www.jetpress.org/volume1/moravec.pdf

---

[a] https://en.wikipedia.org/wiki/Hans_Moravec

Re:Does current AI represent a dead end? by legacynl on Friday December 27, 2024 @02:13PM (#42525118)
I think he was approaching the concept from the direction of "how many mips and megabytes do we need to create human level intelligence".

That's a different take than "human level is this many mips and megabytes", i.e. his claims are about artificial intelligence, not about biological intelligence.

The machine learning seems to be modeled after the action potential part of neural communication. But biological neurons can communicate also in different ways, i.e. neuro transmitters. Afaik this isn't modeled in the current ml-models at all (neither do we have a good idea how/why that stuff works). So ultimately it's pretty likely that a ml with a billion parameters does not perform the same as an organic brain with a billion synapses

Re:Does current AI represent a dead end? by cs702 on Friday December 27, 2024 @03:50PM (#42525908)
I never claimed the machines would achieve "human level," however you define it. What I actually wrote at the root of this thread is that we have no way of knowing in advance what the future capabilities of these AI systems might be as we scale them up.
Re:Does current AI represent a dead end? by joe_the_user on Friday December 27, 2024 @06:36PM (#42527090)
Your "not apples to apples" concession isn't adequate. You are essentially still saying that a machine running a neural network is compare to the brain of an animal or a person - just maybe different units of measurement. But they're not. It's a matter of dramatically different computing systems, systems that operate very differently (well, don't know exactly how animal brains work but we know enough to know they don't work like GPUs).

Your Moravec article is only looking at what's necessary for computers to have the processing power of animal brains. But you've been up and down this thread arguing that equivalent processing power could be sufficient for a computer to achieve the intelligence of an animal. Necessary vs sufficient is big distinction.

Re:Does current AI represent a dead end? by cs702 on Sunday December 29, 2024 @12:12AM (#42537711)
It might be sufficient. We do not know. We have no way of knowing.

Given their current scale, I don't think we can judge whether current AI systems "represent a dead end" -- or not.

Re:Does current AI represent a dead end? by torginus on Friday December 27, 2024 @02:15PM (#42525134)
Afaict OP's not comparing neuron count, but neuron-to-neuron connections, aka synapses. And considering each synapse (weighted input) to a neuron performs computation, I'd say it's possible it captures a meaningful property of a neural network.
Re:Does current AI represent a dead end? by tshaddox on Friday December 27, 2024 @01:46PM (#42524806)
Most simple comparisons are flawed. Even just comparing the transistor counts of CPUs with vastly different architectures would be quite flawed.
Re:Does current AI represent a dead end? by juped on Friday December 27, 2024 @01:26PM (#42524617)
It was clearly a mistake because people start attempting to make totally incoherent comparisons to rat brains.