News for hackers. Stuff that matters.
Re:The Human Brain Can Create Structures in Up to 11 Dimensions by Zenst on Saturday August 31, 2019 @02:23PM (#20847961)
May well turn out later on that AI is best modeled for speed and detail at 11 bit resolution - after all - evolution has done a lot of work that we equate as machine learning.

Also interesting that 11 is also a prime number. But equally, may just be one of life's coincidences and the human drive to see patterns and understand exactly what is going on - a trait that still advances humanity today.

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by jayd16 on Saturday August 31, 2019 @03:16PM (#20848260)
Evolution also determined a giraffe's lyrngeal nerve should detour down the neck and back.
Re:The Human Brain Can Create Structures in Up to 11 Dimensions by jacquesm on Saturday August 31, 2019 @04:10PM (#20848533)
Apparently the signal arrived too early so a delay loop was spliced in. Score one for ID.
Re:The Human Brain Can Create Structures in Up to 11 Dimensions by therein on Saturday August 31, 2019 @04:35PM (#20848653)
When the giraffe class was first released it was too OP with its tall neck, allowing it to access food previously unreachable to many other classes while also being able to keep an eye on predators lurking at distance. Upon next evolutionary tick, it had to be nerfed.
Re:The Human Brain Can Create Structures in Up to 11 Dimensions by mockingbirdy on Saturday August 31, 2019 @05:15PM (#20848827)
For anyone who doesn't get the reference: Watch TierZoo [1]. Hilarious and informative, especially for gamers.

[1]: https://www.youtube.com/watch?v=6xbQ2WbTp0E

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by fucking_tragedy on Saturday August 31, 2019 @03:19PM (#20848276)
> May well turn out later on that AI is best modeled for speed and detail at 11 bit resolution - after all - evolution has done a lot of work that we equate as machine learning.

I don't see gradient descent or back propagation in biology.

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by Zenst on Saturday August 31, 2019 @03:57PM (#20848458)
Maybe not yet, but for example gradient descent - https://journals.plos.org/plosone/article?id=10.1371/journal...

As for back propagation, I'm sure there are aspects in nature in which translate - maybe the nerves system of some species.

Way to see it is that evolutionary change of any form could in theory be modeled in machine learning. There may be aspects of evolution and how it operates that help refine how we do machine learning.

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by DoctorOetker on Sunday September 01, 2019 @03:27AM (#20850977)
The jury is still out on back-propagation (i.e. reverse accumulation automatic differentiation) within the brain (retrograde signalling from the post-synaptic neuron to the pre-synaptic neuron may still be discovered and turn out to approximate RM AD)

But regarding evolution implementing back-propagation, I agree that is just bonkers, as it would require cells to back-propagate in time information about death or procreation! If our biology implements information time machines, biology would be a lot weirder than it is (and it would imply that we could use that by sequencing an organisms genome (or ensemble of them) to read from the future, and keeping it fed without allowing reproduction, and later when we want to write information back either kill or let it reproduce).

That's just plain nonsense. There can't be back-propagation in evolution without biological time-travel of information.

And machine learning without back-propagation is basically a genetic algorithm, so the claim that "evolution has done a lot of work that we equate as machine learning" would then reduce to a widely accepted fact that nobody disputes and is thus uninformative: "evolution has done a lot of work that we equate as genetic algorithms"

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by Zenst on Sunday September 01, 2019 @05:59AM (#20851433)
"There can't be back-propagation in evolution without biological time-travel of information." You still can't do such time-travel in computers, sure you could simulate it but on a chronological scale in reality, your not time traveling.

To equate this into evolution, if you viewed a species as the model, each generation adapts to the previous generations experience, hence it feeds back into the next generation. That evolution may prevail or that whole lineage dies off. It gets down to the perspective of how you measure that time aspect and define the start point of your time perspective. In a simulation you are arbitrary resetting that time baseline on each model, so the equivalent would be to view the human as a baseline of each birth. yes it gets confusing, but to dismiss it just because you have no actual time-travel from a cosmological perspective and compare to an arbitrary time perspective that runs in a linear temporal realm of the universe is unfair.

But many things are hard to equate, you could say it is like comparing apples to pears, but then there are many perspectives in which you can compare them and find them equal. But you can't take one single perspective and transpose that upon another perspective and presume a conclusion.

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by DoctorOetker on Sunday September 01, 2019 @06:40AM (#20851548)
?

if natural selection were to use back-propagation, then killing or allowing procreation would be measurable not only in the genome right after birth of an IVF organism, but even be measurable in the half genomes of the sperm and egg cells before they met (assuming we reach some non-destructe genome sequencing technology). That would simply make actual natural selection useless. Moreover, if all cells had this capacity, and our neurons are cells too, why don't I have this skill inately?

I stand by my opinion that natural selection does not employ timetravel, and hence also does not employ backpropagation

EDIT: adding, one does not need timetravel for backpropagation in the brain or in a computer, just enough memory or delay bandwidth to store the intermediate values for backpropagation. i.e. the feedback is nearly instantaneous, or low bandwidth from example to scoring, but scoring in natural selection depends on how much offspring one makes before one dies, how can this inform the choice mutations??

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by DoctorOetker on Sunday September 01, 2019 @04:35PM (#20854731)
EDIT: upon rereading you seem to believe I claim computing backpropagation on computers is time travel?
Re:The Human Brain Can Create Structures in Up to 11 Dimensions by salty_biscuits on Saturday August 31, 2019 @05:52PM (#20849001)
Well for gradient ascent you have this.

https://en.wikipedia.org/wiki/Chemotaxis

Re:The Human Brain Can Create Structures in Up to 11 Dimensions by ianai on Saturday August 31, 2019 @07:11PM (#20849394)
iirc, back propagation sounds similar in inspection to some of the processes seen in sleeping brains. Ie what they see in MRIs looks like what back propagation might look like from outside. But I’m really not comfortable enough with these terms to speak about them.