News for hackers. Stuff that matters.
Re:Alexa suggests lethal challenge to child by c7DJTLrn on Tuesday December 28, 2021 @09:56AM (#29714334)
Personally I draw the line at the Winograd Schema Challenge. When that's passed I will be truly convinced.
Re:Alexa suggests lethal challenge to child by qayxc on Tuesday December 28, 2021 @12:22PM (#29715766)
According to Wikipedia, GPT-3 is almost there (88% vs ~92%) and a finetuned BERT even achieves >90%. So it stands to reason that a finetuned GPT-x would pass the test with flying colours albeit arguably not being very capable at "common sense reasoning" (whatever that should be, as "common sense" is often enough wrong).

I am sceptical of such tests, as all they do is provide yet another way to game the system instead of demonstrating whatever arbitrary construct scientists use to weasel around the fact that they don't actually know what they even mean by "intelligence".

IMHO we'd be better off defining characteristics for various levels/types of intelligence and trying to categorise our machines and fellow creatures accordingly.