News for hackers. Stuff that matters.
Re:Geoffrey Hinton leaves Google and can now speak freely ab... by comp_throw7 on Tuesday May 02, 2023 @02:02AM (#35783904)
Construct validity!

I suppose, when GPT-4 writes correctly working code that does what you want on the first try, this says absolutely nothing about its cognitive capacity, because, after all, it's just a proxy measurement for the underlying generative process. (Yes, obviously the cognition is _different_ from what happens in humans. That does not mean that... it isn't intelligence?)

Re:Geoffrey Hinton leaves Google and can now speak freely ab... by dragonwriter on Tuesday May 02, 2023 @03:23AM (#35784411)
> I suppose, when GPT-4 writes correctly working code that does what you want on the first try, this says absolutely nothing about its cognitive capacity

It says something about its ability to write code. Beyond that... its impossible to say.

We simply don’t have the information about generative AI models to be able to generalize from limited proxies about them; psychometry is not transferrable from humans to them — or at least, we have neither evidence nor a strong theoretical reason to think it should be.