News for hackers. Stuff that matters.
Re:GPT Takes the Bar Exam by ilaksh on Monday January 09, 2023 @05:22AM (#34308772)
AI can play chess, Go, Jeopardy, StarCraft, Minecraft, Atari games, write essays, summarize text, answer almost any question, drive a car, do above average on a SAT test, fool many people into wondering on Twitter if there were real people typing answers, write chapters of books, act as a dungeon master, write code to spec, win programming competitions, act as a therapist, fold proteins, provide medical diagnosis, visualize any image you describe, visualize any video clip you describe, animate characters, understand spoken language, take drive-thru orders, translate, tell jokes on any topic on demand (vastly funnier than you, would bet anything on that), write songs (music and lyrics), recreate a scene from any angle based on some photos, impersonate any person speaking in video and/or audio, impersonate any person's writing style, imitate any art style.

It's quite possible that AI and robotics will fully surpass humans in all tasks in the next several years and you will still be in denial. Along with millions of others.

Re:GPT Takes the Bar Exam by lm28469 on Monday January 09, 2023 @05:38AM (#34308883)
> AI can .... drive a car

Yeah no. Everything in your list should be prefixed by "kinda", and "kinda" doesn't really cut it in most of these situations.

They certainly are good tools but it's very far from what it promised, even decades ago.

> still be in denial

AI bros are in denial since 1950. With ifs and buts you can write compelling arguments for anything, in the meantime reality is a thing and virtually none of what you wrote is part of reality.

People like you are still in the "everyone will for sure have flying cars by 2000" stage of the new iteration

Re:GPT Takes the Bar Exam by sirsinsalot on Monday January 09, 2023 @06:45AM (#34309286)
My mother can "kinda" drive.
Re:GPT Takes the Bar Exam by lm28469 on Monday January 09, 2023 @08:41AM (#34310172)
And that's exactly why she's not the taxi driver of everyone on earth
Re:GPT Takes the Bar Exam by newaccount74 on Monday January 09, 2023 @05:36AM (#34308871)
Aside from games, AI can do all these things only with human assistance.

It's like saying "Excel can do your taxes". Sure, it can, if you put the correct numbers and formulas into the cells first.

Re:GPT Takes the Bar Exam by candiodari on Monday January 09, 2023 @06:35AM (#34309231)
You forget that a lot of these are moving the goal posts.

AI beat the top players at all those games, but new rules were introduced until AI researchers mostly abandoned those efforts. For instance, the starcraft AI found a really good build order that let it quickly build "Stalkers", a versatile but relatively weak unit. I will note that that build order had several factors that humans found very surprising (consistently oversaturating resource collection by a lot), then controlled those stalker units so well even world-champion level players couldn't match them, with double the APM (meaning the human was allowed 2 actions for every 1 action the AI could take).

In chess the rules have become ... almost ridiculous. Due to cheating, in chess championships you now are "only allowed to play the moves any of the top 3 AIs would play twice in a match, after the first 5 moves". In other words the rules are utterly dependent on humans being worse than AIs. Like in starcraft, btw, AIs have gotten so confident beating human players that a general critique of AI players is that they've gotten "agressive, to the point it's insulting to human players", as one Youtube video put it.

AIs ... beat the average human at driving cars, hell, even Tesla's autopilot beats something like the 98% percentile driver in safety, and Waymo's "chauffeur" is apparently much better than that. I've used chauffeur, and driven behind/around a car controlled by chauffeur. You know what my main comment is? Waymo's chauffeur religiously follows traffic laws (speed limit, stopping at "stop" signs, taking excessive time to manoeuvre around footpaths, ...), it's incredibly irritating to share the road with it. And safe? I've never had an accident, but it's blatantly obvious to me: Waymo's chauffeur is a much safer driver than I am. And that's with people reacting very aggressive towards it.

The conclusion from people? "It's not safe enough". Somehow that argument does not mean we're taking away 98% of people's driving licenses ... it's a double standard, in other words. Exactly what that's based on, I can't tell you. My theory is that it's 95% based on the terminator movies and 5% on 'people will lose their jobs'.

Oh and if you widen the definition of AIs to any algorithm, then you'll have to admit: AIs ARE trusted above humans. For the following paragraph AI means "algorithm", not necessarily deep learning. Humans cannot fly the vast majority of planes, boats, rockets without "AI" assistance. By this I mean a whole lot of vehicles, from any modern Passenger plane to quadcopters require control inputs that the human nervous system is fundamentally unable to generate. For example, because they're too fast. Modern boats, oil tankers, large container ships, require control inputs that humans can't generate because they're too slow (yes, you can calculate, on paper, and then give control inputs, but nobody does that. It's too hard). For passenger planes, AIs are more trusted than human pilots: there are "autolanding-only" weather conditions. There are no "human pilot only" weather conditions. There are now harbours that have high fines if you let a human control the ship for certain classes of ships.

There are now passenger flights where the pilot's function is the checklist, closing up the plane, and turning on autopilot. Negotiating with ground control, taxiing, taking off, negotiating with ATC, flying the plane, Negotiating again with ground control, landing, taxiing and parking the plane are all done by AI. Some of these functions are even done by deep learning algorithms.

So I contend: the problem with cars is that humans won't LET AIs control cars, and at the moment that describes 95% of the situation. That's still 5% inaccurate, and it will change. Not because Skynet will take over, but because we're building ever more cars that are safer, more performant, more helpful ... generally better because the human driver is surrounded by ever more algorithms. For instance, one example where people, even good drivers, generally agree Tesla's AI does better than themselves is parking. That's a case where people will gladly hand over the reins to AI. Those cases will grow, and grow and grow until humans are out, legislated out even, as is partly done in aviation today.

And, frankly, the problem is not the question "how do we make an algorithm control the car better", but the answer to the question "if a human gets an AI to do something so difficult/stupid it fails, who pays for damages?". That's at least 50% of the problem, if not more.

The transition from "humans do everything" to "AIs do everything" is quite a bit further along than the impression you're giving. I agree with the conclusion that we're not there yet, but we're pretty far along.

And, finally, I'd like to reverse your argument. Let's say we're two AIs in the year 30000, discussing:

> It's like saying "Humans can do your taxes". Sure, they can, if you put the correct numbers and formulas into a book and school them with that book for 18 years first. How does it make any sense? My taxes are due this year.

Re:GPT Takes the Bar Exam by notahacker on Monday January 09, 2023 @07:10AM (#34309442)
Citing software like autoland which slavishly applies the rules humans have programmed into it as a reason why neural networks should be considered better than humans at solving general intelligence problems is moving the goalposts even further the other way...
Re:GPT Takes the Bar Exam by antihero on Monday January 09, 2023 @07:37AM (#34309639)
Not doubting you but do you have some articles for these vast incredible use cases? Seems fascinating.
Re:GPT Takes the Bar Exam by dmurray on Monday January 09, 2023 @07:44AM (#34309704)
> Due to cheating, in chess championships you now are "only allowed to play the moves any of the top 3 AIs would play twice in a match, after the first 5 moves".

This is such utter nonsense that I assume the rest of your post is also closer to being false than being true.

Re:GPT Takes the Bar Exam by lm28469 on Monday January 09, 2023 @08:51AM (#34310282)
> but we're pretty far along.

Go out literally anywhere outside of a major western city and you'll witness just how incredibly wrong you are about this statement.

> and Waymo's "chauffeur" is apparently much better than that

You forgot a major detail, on clear straight and wide californian roads with perfect conditions. Put them in a historical european city or in inda's traffic hell and witness the mayhem

Even waymo's previous ceo was full of doubt: https://www.cnet.com/roadshow/news/alphabet-google-waymo-ceo...

We're still so far away from autonomous vehicles, to the point most still doubt we'll get there one day without rebuilding our entire infrastructure to accommodate it

Teslas can't even drive in snowy or foggy condition, that removes half the planet for 1/3rd of the year, but of course for a FAANG engineer living in the bay that's not a problem, for them we already have fully autonomous cars, it's just an extremely tiny subset of it.

I spent my holidays in a Eastern european country, I'd pay big money to film Musk in a fully autonomous tesla there, it would probably be the funniest shit ever, I bet it would crash in the first mile

Re:GPT Takes the Bar Exam by candiodari on Monday January 09, 2023 @04:14PM (#34316166)
> I spent my holidays in a Eastern european country, I'd pay big money to film Musk in a fully autonomous tesla there, it would probably be the funniest shit ever, I bet it would crash in the first mile

I agree it'd be funny, but crash in the first mile? I'd take that bet.

Re:GPT Takes the Bar Exam by ThalesX on Monday January 09, 2023 @06:33AM (#34309217)
> act as a dungeon master

I've been trying to get it to act as a dungeon master unsuccesfully. Do you have any other leads apart from GPT (ChatGPT or AIDungeon)?

Re:GPT Takes the Bar Exam by ilaksh on Monday January 09, 2023 @03:03PM (#34315230)
AI Dungeon is not too bad on the latest model. https://character.ai has some that are decent.
Re:GPT Takes the Bar Exam by newaccount74 on Monday January 09, 2023 @06:54AM (#34309345)
> not permitted to reply

You may need to wait a few minutes before you can reply. Refresh the page

> The new OpenAI models certainly don't need any help to answer their prompts

I've only tried ChatGPT, and it needs a lot of help if you want it to do useful stuff. 90% of my attempts to get it to do something failed. ChatGPT provides an answer that looks sensible at a first glance, but it misses the point. I needed to try a lot of variations of prompts to actually get it to answer my questions, and once it does it was a lot of effort to check if the answers were correct. That's why I am saying you need human assistance.

Re:GPT Takes the Bar Exam by imtringued on Monday January 09, 2023 @08:47AM (#34310233)
Ok then get rid of all humans, they aren't needed anymore.
Re:GPT Takes the Bar Exam by naveen99 on Monday January 09, 2023 @11:06PM (#34320371)
AI can’t play ping pong, soccer, basketball, fold clothes, clean up a mess. Also, it’s not allowed to accumulate or allocate capital, has no legal standing.

Also, there is entirely too much hype on gpt and it’s unwieldy nature and not enough on bert and actually useful tools.

Re:GPT Takes the Bar Exam by NoPicklez on Monday January 09, 2023 @11:28PM (#34320502)
I asked GPT and it gave multiple examples of where AI has played ping pong.