News for hackers. Stuff that matters.
Re:The Age of AI has begun by deathanatos on Tuesday March 21, 2023 @03:50PM (#35251577)
Oh please.

This is such a trope at this point.

We asked ChatGPT a question about a system the other day. Its response was,

> That number is equivalent to [another number]. That number controls $thing, and that number is the recommended value for thing according to $standard. It relates to $unrelated_thing.

It did the math wrong when converting the number from one unit to another. (From days to seconds.) While it got the gist of the number right in the first half of its response, and it even cites essentially the right source, the claim it says the citation backs … is not backed by the citation. It then goes on to equate it to something that it isn't related to.

It's words, strung together: i.e., bullshit. The higher-level reasoning (like that the math needs to work out, or the citation should actually have the cited claim) are utterly absent, and will never be present in these models no matter how much data you train them on.

The response is at best wrong, and at worst, fools someone into believing that it knows what it is talking about.

But yeah, this is going to replace me.

The actual article is … pretty long-winded, and really lacks specific, concrete examples as to how AI will actually move a needle somewhere. Take this chunk,

> Computers haven’t had the effect on education that many of us in the industry have hoped. There have been some good developments, including educational games and online sources of information like Wikipedia, but they haven’t had a meaningful effect on any of the measures of students’ achievement.

(Wikipedia hasn't had a meaningful effect?! [citation needed] there. Wikipedia affected my own achievements, and it has been a while since I was in school. I can only think that such a high quality encyclopedia is of immense value to students, particularly if you're not lucky enough … old enough? … to have an actual encyclopedia — even the use of the word actual here exposes how much effect Wikipedia has had!)

> But I think in the next five to 10 years, AI-driven software will finally deliver on the promise of revolutionizing the way people teach and learn. It will know your interests and your learning style so it can tailor content that will keep you engaged. It will measure your understanding, notice when you’re losing interest, and understand what kind of motivation you respond to. It will give immediate feedback.

We've been saying this about ads for decades. The last ad I remember seeing was "The Mandela Effect: In Queen's 'We Are The Champtions (sic)' He Doesn't Say '…Of The World'" ((sic: the ad title is factually inaccurate) ; … this is no more related to my interests than any of the many Taboola and Taboola-like junk ads at the bottom of half the Internet now. I have no idea where that ad ponzi scheme even ends.)

> There are many ways that AIs can assist teachers and administrators, including assessing a student’s understanding of a subject and giving advice on career planning. Teachers are already using tools like ChatGPT to provide comments on their students’ writing assignments.

And we're 3 paras in with very little meat here: the only example is "comments on student papers". Given the inability to reason … no, I don't think AI will be evaluating papers anytime soon. (The whole passage … if not the article … feels like a human vaguely touched up the output from GPT.)

And the entire idea of trying to help poor unfortunate souls in desperate places with AI feels very much like God vomit from a Cory Doctorow tale.

Re:The Age of AI has begun by thwayunion on Tuesday March 21, 2023 @03:57PM (#35251671)
The part on education was the most cringe for me.

As a general rule: when rich big egos try to improve education, it ends poorly. Consider the Gates Foundation itself trying to MBAify teaching and then being astounded when it (a) didn't improve student outcomes and (b) drove teachers away (not surprising: if you have put up with MBA levels of brain rot you might as well get paid better than teaching can ever sustainably pay) [1].

[1] https://www.businessinsider.com/bill-melinda-gates-foundatio...

Re:The Age of AI has begun by xtracto on Tuesday March 21, 2023 @04:35PM (#35252146)
I got very let down by GPT a couple of days ago after I asked to give me a couple of options for Korean food in a specific city in Mexico (Torreon, Coahuila), including their address. The thing very sure of itself named 3 restaurants and their corresponding address in that city. But they were completely wrong; the name of the restaurant I think is one from California, and the address is an address for some public office in Torreon, Coahuila.

I was very excited by GPT when it came out, but this showed to me how an absolute confident bullshiter it is. It can't say "I don't know".

Re:The Age of AI has begun by MrScruff on Tuesday March 21, 2023 @04:31PM (#35252081)
I'm not sure anyone is claiming that ChatGPT is going to steal their job. I think most people are just extrapolating the ridiculously steep rate of progression and pondering what the future holds.

Sure, maybe we're about to hit a wall. But I'm not seeing any evidence of that as it stands.

Re:The Age of AI has begun by gfodor on Tuesday March 21, 2023 @03:57PM (#35251663)
You're wrong. I wonder if you've tried GPT-4 yet.
Re:The Age of AI has begun by otabdeveloper4 on Tuesday March 21, 2023 @04:26PM (#35252008)
Let me be facetious here.

If GPT-4 was truly all that, it would be classified and at work in Ukraine (or somewhere) right now. Not running Akinator-tier promo marketing gigs.

Re:The Age of AI has begun by medvezhenok on Tuesday March 21, 2023 @04:36PM (#35252150)
It's not about GPT-3 or GPT-4 per se. It's about the rate of progress and the development of Theory of Mind.

GPT-4 plays ~1400 level chess having never been taught the rules of the game explicitly (except for potentially reading them on one of it's ingested webpages)

Re:The Age of AI has begun by otabdeveloper4 on Wednesday March 22, 2023 @06:41AM (#35259170)
> except for potentially reading them on one of it's ingested webpages

Yeah, that's a pretty huge "except".

Chess literature is just literally hundreds and hundreds of transcripts of chess games. You just need to memorize them.

Re:The Age of AI has begun by wizofaus on Tuesday March 21, 2023 @04:57PM (#35252447)
I would actually assume there is something more powerful than ChatGPT-4 at work helping the US military right now. Likewise for Russia. There's even a possibly that's the reason the conflict is dragging on so long.
Re:The Age of AI has begun by bojan on Tuesday March 21, 2023 @05:15PM (#35252682)
You only think the conflict is dragging on for tomorrow long time because of the media hype that one of the sides is going to win... any day now!

The fact is that most wars tend to drag on for years.

Re:The Age of AI has begun by wizofaus on Tuesday March 21, 2023 @05:41PM (#35252986)
I've never got any impression either side is about to win at all. And yes, there are plenty of wars historically (and even recently, e.g. the Syrian civil war) that have dragged on for many many years. But Putin would never have launched the attack against Ukraine if he thought things would be where they are now. How far off are we from a military-trained AI that could make that sort of prediction accurately?
Re:The Age of AI has begun by plutonorm on Tuesday March 21, 2023 @04:22PM (#35251974)
You are wrong. Try gpt4. Gpt3 showed the glimmer on certain questions. Gpt4 is smart, maybe not quite as smart as me, but I fully expect gpt5 to be as smart or smarter than me.
Re:The Age of AI has begun by JoeyJoJoJr on Tuesday March 21, 2023 @05:24PM (#35252783)
Two years ago it would have been considered “too high level” for an AI to produce art. “It’s just a sophisticated collage” is what some comments would say about Dall.e. Now we are realising that a human’s ability to create art isn’t actually all that special and can be reduced to a model.

A year ago it would have been considered too high level for an AI to provide insightful feedback on the themes contained in the draft of a script, but here we are again.

Every comment here is words strung together, and we are going to realise that we were the ones bullshitting all along. AI will expose that our high levelled reasoning (and who knows what else) is not particularly special.

Re:The Age of AI has begun by simonw on Tuesday March 21, 2023 @06:18PM (#35253465)
Don't ask language models to solve problems that involve math. That's not what they're useful for, and as you've seen here they'll get it laughably wrong.