News for hackers. Stuff that matters.
Re:GPT-4 could pass Bar Exam, AI researchers say by microtherion on Tuesday January 03, 2023 @10:10AM (#34232316)
IF it could (I wouldn't know one way or the other), I'd consider that a damning indictment of the Bar Exam failing to test for sentience, rather than evidence of GPT-4 having attained the same.
Re:GPT-4 could pass Bar Exam, AI researchers say by xyzelement on Tuesday January 03, 2023 @10:18AM (#34232431)
Bar exam is not a test of sentience but of the ability to recall, interpret, and apply the law. Because law is an entirely textual thing, I would expect GPT to be exceedingly well suited for it.

I've said for a long time that most doctors and lawyers are just databases with quick and imperfect retrieval.

Re:GPT-4 could pass Bar Exam, AI researchers say by forgetfulness on Tuesday January 03, 2023 @10:22AM (#34232493)
Maybe the "talk about your issue and get a diagnosis" area of practice (internal medicine?); since far less sophisticated manual labor can't yet be automated, surgeons are going to be irreplaceable for longer than, say, BI, and many backend or frontend developers.
Re:GPT-4 could pass Bar Exam, AI researchers say by phpisthebest on Tuesday January 03, 2023 @10:27AM (#34232586)
If House taught me anything it is that People Lie, and you do not have to talk to patients to diagnose them /s
Re:GPT-4 could pass Bar Exam, AI researchers say by VBprogrammer on Tuesday January 03, 2023 @10:38AM (#34232793)
I wonder if people could be more honest with a sub-sentient AI than they could be with a real life doctor. I bet they currently are more honest in their Google searches than they are with the doctor.
Re:GPT-4 could pass Bar Exam, AI researchers say by dumbfounder on Tuesday January 03, 2023 @11:10AM (#34233286)
If that's all a lawyer needs to do then AI should be able to take over large portions of the law process. I saw a dystopian short recently that explored this: https://tvtropes.org/pmwiki/pmwiki.php/Film/PleaseHold
Re:GPT-4 could pass Bar Exam, AI researchers say by booleandilemma on Tuesday January 03, 2023 @12:22PM (#34234484)
And so as AI advances, the goal posts for what counts as intelligence are moved yet again.
Re:GPT-4 could pass Bar Exam, AI researchers say by andsoitis on Friday January 06, 2023 @10:47AM (#34276004)
Maybe a useful way to think about it is that we don't know for sure what intelligence is nor how the gradient of intelligence expresses itself. For instance, does a human grow in intelligence as it ages (a baby doesn't "know" stuff, but has the capacity for learning and then applying in new situations as its experience grows).

I interpret your statement as implying that ChatGPT is somewhere on the spectrum of intelligence, yes?

Re:GPT-4 could pass Bar Exam, AI researchers say by w1nst0nsm1th on Tuesday January 03, 2023 @01:46PM (#34235951)
In english based common law system, a judge can take an original decision on a specific case, such decision entering then the rules of law.

https://en.wikipedia.org/wiki/Common_law#Basic_principles_of...

An AI based on a statistic algorithm (that what AI are) would not be able to make such a decision.

Re:GPT-4 could pass Bar Exam, AI researchers say by evouga on Tuesday January 03, 2023 @10:45AM (#34232890)
Right. Would we be impressed if a layman could pass the bar, given infinite time and access to the entire Internet (including the copious amount of bar exam study guides and worked example problems)? If not why are we impressed that a language model trained on that data can?

Meanwhile when I ask ChatGPT which of six numbers are odd, it confidently reports a mix of even numbers, odd numbers, and letters.

This is a fun milestone but the angst above about the “end of commoditized intelligence” etc. is unwarranted.

Re:GPT-4 could pass Bar Exam, AI researchers say by tandr on Tuesday January 03, 2023 @12:54PM (#34235031)
Maybe it understood "odd" in a different sense of the word? As in "unusual", whatever the "unusual" is for an AI...
Re:GPT-4 could pass Bar Exam, AI researchers say by curriculum on Tuesday January 03, 2023 @01:47PM (#34235961)
Along the same lines, asking

> How many words are in the sentence "This is a test of artificial intelligence"?

yields an answer of:

> There are 8 words in the sentence "This is a test of artificial intelligence."

(There are 7).

Re:GPT-4 could pass Bar Exam, AI researchers say by coderoffortune on Tuesday January 03, 2023 @04:36PM (#34238433)
My guess is that AI omitted 'a' because this is essentially how natural language processing works. Perhaps it cannot see 'a' because the input has been stripped of 'a' or 'the', and so on.