News for hackers. Stuff that matters.

A comment on ChatGPT scores 80% on SAT reading/writing with collective chain of thought. Parent comment

Re:ChatGPT scores 80% on SAT reading/writing with collective... by pooper on Sunday January 15, 2023 @07:08AM (#34388808)
> A human doing the same SATs will test roughly the same way every time.

> ChatGPT has achieved 80% in this user's run, will refuse to play at all the next run, will get 45% the following run etc.

While I agree with your conclusion, I want to slightly modify the first sentence. I know this is just one anecdote but I took the SAT 1 twice and did somewhat better the second time. I think this is common as you are more familiar with the test the second time.

[ Parent | on HN ]
Re:ChatGPT scores 80% on SAT reading/writing with collective... by hattmall on Sunday January 15, 2023 @12:39PM (#34391226)
I don't think that make sense at all. Why would a human test the same multiple times? Everyone I know took the SAT multiple times with increasing results. I don't know of anyone that's achieved a perfect score with only one try and most people could get a perfect score with enough studying and attempts.

My SAT score ranged from 980 to 1450 with 4 tries, increasing each time and had there been a reason or benefit I'm certain I could have eventually gotten a perfect score. I don't see how anyone could not get better over time.

[ Parent | on HN ]