News for hackers. Stuff that matters.
Re:Were RNNs All We Needed? by actionfromafar on Thursday October 03, 2024 @06:39PM (#41735837)
Unless we could build chips in 3D?
Re:Were RNNs All We Needed? by foota on Thursday October 03, 2024 @07:11PM (#41736038)
Not even then, a truly fully connected network would have super exponential runtime (it would take N^N time to evaluate)
Re:Were RNNs All We Needed? by ivan_gammel on Thursday October 03, 2024 @07:28PM (#41736146)
We need quantum computing there. I remember seeing a recent article about quantum processes in the brain. If that’s true, QC may be the missing part.
Re:Were RNNs All We Needed? by eru on Thursday October 03, 2024 @09:54PM (#41737066)
Compare and contrast https://www.smbc-comics.com/comic/the-talk-3

(Summary: quantum computing is unlikely to help.)

Re:Were RNNs All We Needed? by tsimionescu on Friday October 04, 2024 @07:17AM (#41740226)
This is just word salad.

There is no known quantum algorithm that can compute the result of a fully-connected neural network exponentially faster than classical computers can. QCs have a known exponential advantage over classical computers only for a very limited class of problems, mostly related to the Quantum Fourier Transform.

Animal brains have little to nothing in common to artifical neural networks. There is no reason whatsoever to think that there is any relation between the complexity class of brain functions and ANN inference.

And the hypothesized (and still wildly speculative) quantum behaviors happening in the animal brain are at the level of the behavior of individual neurons, not of the network connections between neurons. So even if there is some kind of quantum computation happening, it's happening in individual neurons, not at the network level, and that would only go to show even more that animal brains are profoundly different from ANNs.

Re:Were RNNs All We Needed? by mvkel on Friday October 04, 2024 @01:29AM (#41738130)
Wetware is the future.
Re:Were RNNs All We Needed? by fennecfoxy on Friday October 04, 2024 @10:43AM (#41741956)
Can't wait to see this defiantly spray painted across a torn up brick wall while computronium brained super intelligences slowly disassemble our planet to make paperclips.
Re:Were RNNs All We Needed? by mvkel on Saturday October 05, 2024 @10:51PM (#41754390)
Re:Were RNNs All We Needed? by ComputerGuru on Thursday October 03, 2024 @09:44PM (#41737003)
Heat extraction.
Re:Were RNNs All We Needed? by bob1029 on Friday October 04, 2024 @01:54AM (#41738257)
We are already doing this.