Neural Networks and the Chomsky Hierarchy [DeepMind, 2022]

Re:Neural Networks and the Chomsky Hierarchy [DeepMind, 2022] by randorand0 on Monday January 23, 2023 @05:40AM (#34487340)

but what about human intellingence, clearly it does not require infinite anything.

also, what about accumulated 'memory' in our human culture? how finite is that? how do you quantify this? (I'd think it'd be quantified by a timestamp, like a reference to an era or an historic age?? shrug)

> How to define an abstract neural network with some explicit memory component, which can grow to infinite sizes?

I think "culture" is the answer.. but maybe I actually mean a free "natural language" (in contrast with a formal (or synthetic) language)

[ Parent | on HN ]

Re:Neural Networks and the Chomsky Hierarchy [DeepMind, 2022] by albertzeyer on Monday January 23, 2023 @07:07AM (#34487883)

A human does not require infinite memory because most problems the human needs to solve only require finite memory.

But also, a human can easily augment his/her own memory by some pen and paper, or by a computer. That way, a human can solve more complex problems.

[ Parent | on HN ]