GPT4 is far from being able to pass such a test, and I don't expect GPT99 to get there either. A fundamentally different approach will be needed.
Passing such a test is not a property expected of the average human yet the average human is considered a general intelligence, therefore this is not a property of a general intelligence.
Intelligence is independent of one's knowledge. Plenty of intelligent but uneducated people, and plenty of educated people - or even people with perfect recall - that are not particularly intelligent.
If you are testing intelligence you should be able to distill it to particular tests independent of domain expertise.
Any intelligent agent should be capable of in-context learning.
So how would you go about doing that?
I'm thinking of the rabbit hole that is the hurdle to get citizenship in a particular country. "Outsiders" have to apply, pay, take and pass the test. "Insiders" don't have to take the test, they pass by default. Even if they don't know the answers to the test.
Just like the constant annoying 'apologies' do not in any way signify the model actually feels sorry.
So your average corporation?
>I would say that the strings that are output by LLMs may fluently describe intent and purpose, but that actual intent requires a self awareness that utterly absent
The only reason I only partially/somewhat agree with this is current LLMs have no learning feedback loop as a means of short term actions to long term improvement. The moment that changes I'll take your statement and throw it in the trash bin of history. LLMs output have no (at least self-)purpose because they are just text output. The moment that text output goes to tooling, that tooling performs actions, and those actions are fed back into training the model then purpose is given. The self awareness loop is complete.
That's quite the claim. Can you provide references?
I'd like to see this proof. Everything we've seen so far is just the AI reproducing what humans do, which happens to be writing with intent.
I don't understand why anyone even bothers using the term given in any serious discussion you need to define it up front anyway.