Re:Natural language benchmarks don’t measure AI models’ gene...
by mjburgess on Monday August 24, 2020 @08:35AM
(#24259989)
Approximately, the semantics of natural language are concepts. Concepts in this sense are deep bodily-inferential-causal models.
If I say, "No! The glass is under the desk" you can immediately: find the glass, reason about why you havent previously found it, ask for the glass to be filled, ask for the glass to be handed to you, report on whether you like where the glass is..
You could say, "Why is the glass on the floor!?" angrily.
And by doing so communicate an expectation about where glasses ordinarily are, express a desire-frustration, express a confusion over the intentions of others..
The information contained in "No! The glass is under the desk" is VAST.
It is vast because our understanding of the world is vast. Not because the sentence as a lot of letters. Not because the words in it occur in a certain frequency. Nothing about the sentence itself is vast. It is profoundly shallow.
Intelligence is this vastness. Intelligence is moving effortlessly from "why" to "how" to "when" to "what" across domains, across hypothetical/counterfactual scenarious, across intentions/expectations.
This vastness is laden in animal minds, even, essentially constitutive of animal minds. And it cannot be found in "data".
It is grown by the complex biophysical process of learning, which requires a deep (& playful) interaction with the environment. The environment grows your capacities as you play with it.
If I say, "No! The glass is under the desk" you can immediately: find the glass, reason about why you havent previously found it, ask for the glass to be filled, ask for the glass to be handed to you, report on whether you like where the glass is..
You could say, "Why is the glass on the floor!?" angrily.
And by doing so communicate an expectation about where glasses ordinarily are, express a desire-frustration, express a confusion over the intentions of others..
The information contained in "No! The glass is under the desk" is VAST.
It is vast because our understanding of the world is vast. Not because the sentence as a lot of letters. Not because the words in it occur in a certain frequency. Nothing about the sentence itself is vast. It is profoundly shallow.
Intelligence is this vastness. Intelligence is moving effortlessly from "why" to "how" to "when" to "what" across domains, across hypothetical/counterfactual scenarious, across intentions/expectations.
This vastness is laden in animal minds, even, essentially constitutive of animal minds. And it cannot be found in "data".
It is grown by the complex biophysical process of learning, which requires a deep (& playful) interaction with the environment. The environment grows your capacities as you play with it.