News for hackers. Stuff that matters.
Re:GPT-4 could pass Bar Exam, AI researchers say by evouga on Tuesday January 03, 2023 @10:45AM (#34232890)
Right. Would we be impressed if a layman could pass the bar, given infinite time and access to the entire Internet (including the copious amount of bar exam study guides and worked example problems)? If not why are we impressed that a language model trained on that data can?

Meanwhile when I ask ChatGPT which of six numbers are odd, it confidently reports a mix of even numbers, odd numbers, and letters.

This is a fun milestone but the angst above about the “end of commoditized intelligence” etc. is unwarranted.

Re:GPT-4 could pass Bar Exam, AI researchers say by tandr on Tuesday January 03, 2023 @12:54PM (#34235031)
Maybe it understood "odd" in a different sense of the word? As in "unusual", whatever the "unusual" is for an AI...
Re:GPT-4 could pass Bar Exam, AI researchers say by curriculum on Tuesday January 03, 2023 @01:47PM (#34235961)
Along the same lines, asking

> How many words are in the sentence "This is a test of artificial intelligence"?

yields an answer of:

> There are 8 words in the sentence "This is a test of artificial intelligence."

(There are 7).

Re:GPT-4 could pass Bar Exam, AI researchers say by coderoffortune on Tuesday January 03, 2023 @04:36PM (#34238433)
My guess is that AI omitted 'a' because this is essentially how natural language processing works. Perhaps it cannot see 'a' because the input has been stripped of 'a' or 'the', and so on.