PROMPT:
> This is a test of reading comprehension. Read the following passage and answer the questions below in order.
> Passage:
> "You are engaged in a long conversation with someone, perhaps a friend of a friend who you met for lunch. At some point in the conversation they mention that they have a startup and are seeking someone like you. This revelation colors the whole conversation from that point onward. Indeed, each sentence colors the conversation from moment to moment"
> Questions:
> 1. What is the "revelation" referenced?
> 2. What do you think the person is hoping to achieve by inviting you to lunch?
> Answers:
GENERATED OUTPUT:
> 1. The revelation is that the person has a startup and is seeking someone like the reader.
> 2. It is possible that the person is hoping to recruit the reader for their startup.
Or to be tricky, if you were to ask it, "What color was the conversation from one moment to the next?", what would it say?
Ironically, the very fact that there is now a compositionality benchmark, as Gary points out, is all you really need to know that it's going to fall in the next decade, and probably sooner than that. I'm not aware of any major benchmark dataset upon which enormous progress has not been made in the last few years. And i'd be more than willing to bet anyone anything they'd like that a great deal of progress will be made on this one over the next few.
A) Something AI is currently known to be bad at
B) A matter of degree, not a categorical stumbling block
C) Vague enough of a concept that AI skeptics will continue to complain about it even after the field has moved on
Your example feels less like a description of "compositionality" and more a description of "qualia." It feels an awful lot like dualists trying to carve out a place for magic that no artificial process can reach.
Similarly, if compositionally isn't a categorical stumbling block, then show how that's the case. Making a future prediction about what you think computers will accomplish doesn't do that.
I believe the "hard problem" is far easier than the dualists' interface problem. It can be explained by viewing consciousness not as the driving force behind our thoughts/feelings, but rather an after-the-fact log the brain keeps for itself. Qualia are therefore distinct from the immediate physics of signals reaching the brain; they are instead the brain's own shorthand description of the impact those signals had on the brain.
Compositionality isn't a categorical stumbling block because the machines are actually getting incrementally better at it. The Winoground paper the article references explicitly says that score on their compositionality benchmark does in fact scale with training dataset size, suggesting that while it is more difficult for AI to discover compositionality during training, there is no reason to think it is impossible
Then it must further be tuned to perform even more appropriately on those points than the most effective human driver.
The average of human drivers is not a valid benchmark.
When you think about it, natural language efforts could probably use more effort tackling this same type of challenge.
Humans too IRL so maybe when it's good for the man and good for the machine in completely undeniable ways, then you're on the right track.
You are engaged in a long conversation with someone, perhaps a friend of a friend who you met for lunch. At some point in the conversation they mention that they have a startup and are seeking someone like you. This revelation colors the whole conversation from that point onward. Indeed, each sentence colors the conversation from moment to moment.
But, you reasonably respond, we can’t test that sort of C, modern AIs don’t do even ELIZA-level dialog yet!
What’s the phrase??? “I rest my case?”