News for hackers. Stuff that matters.
Re:ChatGPT scores 80% on SAT reading/writing with collective... by mrtksn on Sunday January 15, 2023 @06:05AM (#34388526)
Yeah, I use it to and I'm a big fan of ChatGPT and the other recent ML tools but I'm not under the illusion that this is intelligent machine.

The test is not useless, the test's use case is to create a standardised datapoint to pick people to limited spots. That' what the test does, you need to attach false attributes to the test(like measures intelligence) to associate these attributes to the machine and this is a fallacy because although the test probably says something about the intelligence of the human, it does it by measuring meta attributes of the intelligence of the human(like speed of solving problems that the human was supposed to train on).

This is also why there is the "Goodhart's law" phenomenon where in this case students instead of learning physics might start putting all their effort on learning to solve physics tests and you end up with students with very high scores in physics but with no understanding of physics.

Re:ChatGPT scores 80% on SAT reading/writing with collective... by logicallee on Sunday January 15, 2023 @08:05PM (#34395524)
I've used ChatGPT a lot. It is an intelligent machine.
Re:ChatGPT scores 80% on SAT reading/writing with collective... by mrtksn on Sunday January 15, 2023 @08:14PM (#34395595)
I guess if you define intelligence the correct way the calculators are intelligent. Anyway, what makes you think that you are in a unique position on having experience with chatGPT?
Re:ChatGPT scores 80% on SAT reading/writing with collective... by logicallee on Sunday January 15, 2023 @09:43PM (#34396192)
My definition isn't so wide, most calculators don't manipulate abstract concepts in a way that makes me think they are an intelligent machine.

The reason I prefaced my opinion with "I've used ChatGPT a lot" is to show that this is my personal impression based on my real everyday experience - I'm not guessing or deducing. I personally interact with ChatGPT in a way that satisfies me as to the fact that it is an intelligent machine capable of very usefully handling abstract notions.