News for hackers. Stuff that matters.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by adamnemecek on Wednesday October 25, 2017 @12:25PM (#15551514)
I'm probably talking out of my ass but I'm somewhat suspect of a cortex having straight up columns. I'm curious whether these are artifacts of the fact that linear algebra seems to be the dominant algebra in ML/modeling of human perception. Recently I've been dipping my feet into geometric algebra which seems to be the superior algebra for just about anything you can think of (human perception but also like all of physics, Maxwell's 4 equations are reduced to a single equation in GA) and it's particularly better for reasoning about spaces which this seems to be all about.

And unlike linear algebra it actually makes sense (e.g. why is cross product only in three dimensions?, wtf are determinants esp. in the context of matrix division all about?).

This blog post introduces GA and talks about it's relationship to human perception.

https://slehar.wordpress.com/2014/03/18/clifford-algebra-a-v...

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by lamename on Wednesday October 25, 2017 @12:45PM (#15551689)
Cortical columns exist [1]; think perpendicular to the surface of the cortex [2, 2nd image, or just image search "cortical column"]. This is due to the morphology of cortical neurons. My understanding is that a column can be thought of as a functional unit, and passing information across columns adds complexity.

Of course biology is messy and there's tons of variation depending on which brain region you're looking at, but Visual Cortex was one of the earliest places this was observed. It gets complicated and detailed quickly, and I'm somewhat out of my element here.

[1] https://en.wikipedia.org/wiki/Cortical_column [2] http://www.mbfbioscience.com/blog/2012/01/neurolucida-helps-...

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by SubiculumCode on Wednesday October 25, 2017 @01:05PM (#15551864)
There are, of course lateral connections between columns, but the columns are very real.

I dont see what geomettic algebra has to with it, as the grandparent suggests.

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by adamnemecek on Wednesday October 25, 2017 @01:10PM (#15551912)
They are performing spatial reasoning and GA is a better algebra for that.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by SubiculumCode on Wednesday October 25, 2017 @01:15PM (#15551952)
I mean I don't see why geometric algebra bears on the factual existence of column-like structure perpendicular to the cortical surface in real brains. Geometric algebra may bear on what those columns do, but it is not relevant to whether the columns exist. This is a matter of observing network wiring from brain preparations.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by kortex on Wednesday October 25, 2017 @11:15PM (#15556100)
I think it has something to do with the power of building hierarchical layers of abstraction, to make increasingly precise predictions about the world.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by rdlecler1 on Wednesday October 25, 2017 @01:29PM (#15552103)
I would have assumed it was reducing complexity filtering out noise and compressing information), not adding it?
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by gowld on Wednesday October 25, 2017 @12:38PM (#15551633)
Linear algebra is equivalent to geometric algebra so you wouldn't find columns less likely in GA.

Also, GA is usually hyped by non-mathematicians -- people who don't understand that it's just an alternative notation that doesn't add much to linear algebra.

> Clifford Algebra, a.k.a. Geometric Algebra, is a most extraordinary synergistic confluence of a diverse range of specialized mathematical fields

> It is the very simplicity and generality of Clifford Algebra that confirms its “truth”

kook alarms ringing

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by adamnemecek on Wednesday October 25, 2017 @12:48PM (#15551717)
> Linear algebra is equivalent to geometric algebra

That depends on your definition of equivalent. They have the same computational power but things make sense in one and less in the other.

> Also, GA is usually hyped by non-mathematician

What a loaded statement.

> kook alarms ringing

You aren't the first one to say it. Nonetheless, the author is a researcher at Harvard it seems http://cns-alumni.bu.edu/~slehar/Lehar.html

Don't let the form fool you. You can also read any of the many books on the topic.

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by gowld on Wednesday October 25, 2017 @05:59PM (#15554667)
> Research Fellow in Ophthalmology, Harvard University

And I'm sure he's a fine opthalmologist.

> I am an independent researcher with a novel theory of mind and brain, inspired by the observed properties of perception. These observations are confirmed by some peculiar anomalies in phenomenal perspective. The implications of these observations are that the foundational assumptions of neuroscience are fundamentally in error, and that an alternative paradigm of neurocomputation will have to be formulated to account for the properties of consciousness and perception.

If it quacks like a quack...

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by kkylin on Wednesday October 25, 2017 @12:43PM (#15551673)
Mammalian cortex (well, in the species that have been studied closely) has both laminar and columnar structures. If you are interested in the biology side of things, take a look at

  http://hubel.med.harvard.edu/book/bcontex.htm
Caveat: it's pretty old, and is probably not quite right in a number of ways. But IMHO still a reasonable lay-person's introduction to what we know about the organization of the early visual pathway.

(Whether this has got anything to do with ML, I'm not in a position to say.)

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by madhadron on Wednesday October 25, 2017 @12:50PM (#15551737)
You're confusing Gibbs-Heaviside vectors with linear algebra. Linear algebra is the study of linear spaces and linear operators between them. Endowing those spaces with a norm or a dot product is usually as far as linear algebra courses go.
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by adamnemecek on Wednesday October 25, 2017 @12:52PM (#15551750)
Are you saying that cross product isn't a part of linear algebra?
Re:Why Does the Neocortex Have Columns? A Theory of Learning... by madhadron on Thursday October 26, 2017 @09:52AM (#15558772)
I am.

I suppose you could say that any linear space equipped with some product on it falls into linear algebra, in which case it would be, but an obscure corner at best. Its sole application is electromagnetism in a non-relativistic formulation. That's a hugely important application if you're a physicist, but compared to the number of applications of linear algebra it's basically negligible.

The inner product is the only one usually taught in linear algebra, and that's because it's central to talking about representations of linear operators in bases.

Re:Why Does the Neocortex Have Columns? A Theory of Learning... by wbl on Wednesday October 25, 2017 @12:49PM (#15551726)
What definition of linear algebra doesn't include the Clifford functor?