News for hackers. Stuff that matters.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Friday May 17, 2024 @07:29PM (#40395132)
Adding a disclaimer for people unaware of context (I feel same as you):

OpenAI made a large commitment to super-alignment in the not-so-distant past. I beleive mid-2023. Famously, it has always taken AI Safety™ very seriously.

Regardless of anyone's feelings on the need for a dedicated team for it, you can chalk to one up as another instance of OpenAI cough leadership cough speaking out of both sides of it's mouth as is convenient. The only true north star is fame, glory, and user count, dressed up as humble "research"

To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by jasonfarnon on Friday May 17, 2024 @07:45PM (#40395240)
To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

What's his track record on promises/predictions of this sort? I wasn't paying attention until pretty recently.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Friday May 17, 2024 @08:07PM (#40395372)
As a child I used to watch a TV programme called Tomorrows World. On it they predicted these very same things in similar timeframes.

That programme aired in the 1980's. Other than vested promises is there much to indicate it's close at all? Empty promises aside there isn't really any indication of that being likely at all.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by zdragnar on Friday May 17, 2024 @08:41PM (#40395572)
In the early 1980's we were just coming out of the first AI winter and everyone was getting optimistic again.

I suspect there will be at least continued commercial use of the current tech, though I still suspect this crop is another dead end in the hunt for AGI.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Saturday May 18, 2024 @04:55AM (#40397479)
I'd agree with the commercial use element. It will definitely find areas that it can be applied. Just currently it's general application by a lot of the user base feel more like early Facebook apps or subjectively better Lotus Notes than an actual leap forward of any sort.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by Davidzheng on Friday May 17, 2024 @09:03PM (#40395685)
are we living in the same world?????
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Saturday May 18, 2024 @04:51AM (#40397466)
I would assume so. I've spent some time looking into AI for software development and general use and I'm both slightly impressed and at the same time don't really get the hype.

It's better and quicker search at present for the area I specialise in.

It's not currently even close to being a x2 multiplier for me, it possibly even a negative impact, probably not but I'm still exploring. Which feels detached from the promises. Interesting but at present more hype than hyper. Also, it's energy inefficient so cost heavy. I feel that will likely cripple a lot of use cases.

What's your take?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Saturday May 18, 2024 @05:15PM (#40402172)
Yes

Incredulous reactions don't aid whatever you intend to communicate - there's a reason why everyone knows what AI the last 12 months, it's not made up or a monoculture. It would be very odd to expect discontinuation of commercial use without a black swan event

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Friday May 17, 2024 @07:47PM (#40395249)
honestly, I hadn't heard of him until 24-48 hours ago :x (he's also the new superalignment lead, I can't remember if I heard that first, or the podcast stuff first. Dwarkesh Patel podcast for anyone curious. Only saw a clip of it)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @07:48PM (#40395261)
>To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

Link? Is the ~2 year timeline a common estimate in the field?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by heavyset_go on Friday May 17, 2024 @08:28PM (#40395502)
We can't even get self-driving down in 2 years, we're nowhere near reaching general AI.

AI experts who aren't riding the hype train and getting high off of its fumes acknowledge that true AI is something we'll likely not see in our lifetimes.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @08:40PM (#40395568)
Can you give some examples of experts saying we won't see it in our lifetime?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by danielbln on Saturday May 18, 2024 @06:20AM (#40397787)
Is true AI the new true Scotsman?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by ctoth on Friday May 17, 2024 @07:54PM (#40395296)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @08:20PM (#40395446)
Is the quote you're thinking of the one at 19:11?

> I don't think it's going to happen next year, it's still useful to have the conversation and maybe it's like two or three years instead.

This doesn't seem like a super definite prediction. The "two or three" might have just been a hypothetical.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by HarHarVeryFunny on Saturday May 18, 2024 @09:08AM (#40398723)
Right at the end of the interview Schulman says that he expects AGI to be able to replace himself in 5 years. He seemed a bit sheepish when saying it, so hard to tell if he really believed it, or if was just saying what he'd been told to say (I can't believe Altman is allowing employees to be interviewed like this without telling them what they can't say, and what they should say).
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by dboreham on Friday May 17, 2024 @07:51PM (#40395279)
It's the "fusion in 20 years" of AI?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by dinvlad on Saturday May 18, 2024 @01:21AM (#40396602)
Just like Tesla "FSD" :-)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by CuriouslyC on Friday May 17, 2024 @08:01PM (#40395345)
They can't even clearly define a test of "AGI" I seriously doubt they're going to reach it in two years. Alternatively, they could define a fairly trivial test and reach it last year.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by jfengel on Friday May 17, 2024 @09:48PM (#40395900)
I feel like we'll know it when we see it. Or at least, significant changes will happen even if people still claim it isn't really The Thing.

Personally I'm not seeing that the path we're on leads to whatever that is, either. But I think/hope I'll know if I'm wrong when it's in front of me.