News for hackers. Stuff that matters.
Re:Chomsky and the Two Cultures of Statistical Learning by Calavar on Friday November 06, 2026 @09:15AM (#50392533)
> but from all models, it's the closest

Care to back this up? What evidence do we have to suggest that back propagation and self attention are mechanistically similar to human cognition? Similarity of the outputs says nothing about similarity of the machinery underneath. Turboprop engines tell us nothing about how birds fly - doesn't matter that they successfully transport millions of people around the world.

I would say that when it comes to higher level cognition, logic engines are more human like even if they only have a tiny fraction of the practical utility of LLMs.

Re:Chomsky and the Two Cultures of Statistical Learning by adrian_b on Friday November 06, 2026 @09:26AM (#50392663)
> Turboprop engines tell us nothing about how birds fly

That is not true.

Turboprop engines and flying birds are different things, but there is a set of common properties.

A blade of a screw propeller functions exactly in the same way as a flapping wing of a bird, except that the wing cannot rotate without limits around the body of the bird, so it must stop, change angles and revert the motion, while the blade can rotate continuously around the axis, functioning on one side like a falling wing and on the other side like a raising wing.

Re:Chomsky and the Two Cultures of Statistical Learning by suddenlybananas on Friday November 06, 2026 @09:52AM (#50393024)
We already know that the most basic mechanisms in ANN and actual neurons are very different. Spiking and neurotransmitters are basically everything in brains and don't exist in ANNs.
Re:Chomsky and the Two Cultures of Statistical Learning by NaiveEmpiricist on Friday November 06, 2026 @09:58AM (#50393102)
Also, AFAIK, insects rely on their (flat) flapping wings to create lift by creating vortices.

"Nothing" may be a little too strong -- physics is physics, after all -- but (small) birds and airplanes have Reynolds numbers about 1000x different and different underlying material science.

Airplanes are engineered (with a very small number of exceptions) to be stable during flight, whereas bird flight is inherently unstable, requiring a lot of specialized cognition so birds can fly.

I would think a lot of cognitive ornithologists (who I really hope exist!) would be interested in finding out about this.

At this point, I'm at the complete end of my knowledge of bird flight!

Re:Chomsky and the Two Cultures of Statistical Learning by casualrandomcom on Friday November 06, 2026 @11:42AM (#50394740)
ok, compare a wheel to a human leg. If you look long enough you will find similarities, but you honestly cannot say that you "understand how humans walk" when all you can do is put a man in a wheelbarrow, move it, and say "look! my device accomplishes the same task!"
Re:Chomsky and the Two Cultures of Statistical Learning by Calavar on Saturday November 07, 2026 @02:04AM (#50402321)
> A blade of a screw propeller functions exactly in the same way as a flapping wing of a bird, except that the wing cannot rotate without limits around the body of the bird

This is completely missing the forest for the trees. The "except" in your argument is doing an incredible amount of work. I think it's absurd to claim that the rotating blades of a turboprop are analagous to a bird's wings when planes l have separate structures quite literally called "wings" because they are directly inspired by bird wings. And I think the absurdity of that argument actually serves to prove my point.

Re:Chomsky and the Two Cultures of Statistical Learning by cma on Friday November 06, 2026 @01:32PM (#50396330)
attention + residual seems kind of like Chomsky's merge operation.