News for hackers. Stuff that matters.

A comment on I made ChatGPT take an SAT Test.

Re:I made ChatGPT take an SAT Test by touringa on Saturday December 03, 2022 @01:50AM (#33841320)
In 2020, GPT-3 175B was already outperforming humans on SAT questions by ~20%. There are far more formal benchmarks for models now.

https://lifearchitect.ai/iq-testing-ai/

[ Parent | on HN ]
Re:I made ChatGPT take an SAT Test by bagels on Saturday December 03, 2022 @02:42AM (#33841573)
Surely outperforming some humans? I don't see how it can outperform perfect scores by 20%?
[ Parent | on HN ]
Re:I made ChatGPT take an SAT Test by cypress66 on Saturday December 03, 2022 @06:09AM (#33842584)
Obviously performing better than the average SAT (human) result.
[ Parent | on HN ]