News for hackers. Stuff that matters.
Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by PartiallyTyped on Wednesday March 15, 2023 @04:17PM (#35174143)
Why should a panel exist in the first place if you are not testing knowledge?

Intelligence is independent of one's knowledge. Plenty of intelligent but uneducated people, and plenty of educated people - or even people with perfect recall - that are not particularly intelligent.

If you are testing intelligence you should be able to distill it to particular tests independent of domain expertise.

Any intelligent agent should be capable of in-context learning.

So how would you go about doing that?

Re:GPT4 and the Multi-Modal, Multi-Model, Multi-Everything F... by nradov on Wednesday March 15, 2023 @06:40PM (#35175699)
The (notional) panel exists to evaluate intelligence, not test knowledge or educational achievement. While some basic level of general knowledge would be necessary to even start a test the main focus would be on ability to learn and reason, including metacognition.