News for hackers. Stuff that matters.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by a_wild_dandan on Friday May 17, 2024 @07:24PM (#40395102)
I think superalignment is absurd, and model "safety" is the modern AI company's "think of the children" pearl clutching pretext to justify digging moats. All this after sucking up everyone's copyright material as fair use, then not releasing the result, and profiting off it.

All due respect to Jan here, though. He's being (perhaps dangerously) honest, genuinely believes in AI safety, and is an actual research expert, unlike me.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by thorum on Friday May 17, 2024 @07:51PM (#40395277)
The superalignment team was not focused on that kind of “safety” AFAIK. According to the blog post announcing the team,

https://openai.com/index/introducing-superalignment/

> Superintelligence will be the most impactful technology humanity has ever invented, and could help us solve many of the world’s most important problems. But the vast power of superintelligence could also be very dangerous, and could lead to the disempowerment of humanity or even human extinction.

> While superintelligence seems far off now, we believe it could arrive this decade.

> Managing these risks will require, among other things, new institutions for governance and solving the problem of superintelligence alignment:

> How do we ensure AI systems much smarter than humans follow human intent?

> Currently, we don't have a solution for steering or controlling a potentially superintelligent AI, and preventing it from going rogue. Our current techniques for aligning AI, such as reinforcement learning from human feedback, rely on humans’ ability to supervise AI. But humans won’t be able to reliably supervise AI systems much smarter than us, and so our current alignment techniques will not scale to superintelligence. We need new scientific and technical breakthroughs.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by ndriscoll on Friday May 17, 2024 @08:13PM (#40395412)
That doesn't really contradict what the other poster said. They're calling for regulation (digging a moat) to ensure systems are "safe" and "aligned" while ignoring that humans are not aligned, so these systems obviously cannot be aligned with humans; they can only be aligned with their owners (i.e. them, not you).
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by ihumanable on Friday May 17, 2024 @08:27PM (#40395489)
Alignment in the realm of AGI is not about getting everyone to agree. It's about whether or not the AGI is aligned to the goal you've given it. The paperclip AGI example is often used, you tell the AGI "Optimize the production of paperclips" and the AGI started blending people to extract iron from their blood to produce more paperclips.

Humans are used to ordering around other humans who would bring common sense and laziness to the table and probably not grind up humans to produce a few more paperclips.

Alignment is about getting the AGI to be aligned with the owners, ignoring it means potentially putting more and more power into the hands of a box that you aren't quite sure is going to do the thing you want it to do. Alignment in the context of AGIs was always about ensuring the owners could control the AGIs not that the AGIs could solve philosophy and get all of humanity to agree.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by ndriscoll on Friday May 17, 2024 @08:36PM (#40395551)
Right and that's why it's a farce.

> Whoa whoa whoa, we can't let just anyone run these models. Only large corporations who will use them to addict children to their phones and give them eating disorders and suicidal ideation, while radicalizing adults and tearing apart society using the vast profiles they've collected on everyone through their global panopticon, all in the name of making people unhappy so that it's easier to sell them more crap they don't need (a goal which is itself a problem in the face of an impending climate crisis). After all, we wouldn't want it to end up harming humanity by using its superior capabilities to manipulate humans into doing things for it to optimize for goals that no one wants!

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by tdeck on Saturday May 18, 2024 @01:33AM (#40396650)
Don't worry, certain governments will be able to use these models to help them commit genocides too. But only the good countries!
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by concordDance on Saturday May 18, 2024 @01:59AM (#40396759)
A corporate dystopia is still better than extinction. (Assuming the latter is a reasonable fear)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by simianparrot on Saturday May 18, 2024 @02:31AM (#40396888)
Neither is acceptable
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by portaouflop on Saturday May 18, 2024 @04:52AM (#40397472)
I disagree. Not existing ain’t so bad, you barely notice it.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by wruza on Saturday May 18, 2024 @01:12AM (#40396582)
AGI started blending people to extract iron from their blood to produce more paperclips

That’s neither efficient nor optimized, just a bogeyman for “doesn’t work”.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by FeepingCreature on Saturday May 18, 2024 @06:52AM (#40397907)
You're imagining a baseline of reasonableness. Humans have competing preferences, we never just want "one thing", and as a social species we always at least _somewhat_ value the opinions of those around us. The point is to imagine a system that values humans at zero: not positive, not negative.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by freehorse on Saturday May 18, 2024 @10:01AM (#40399165)
Still there are much more efficient ways to extract iron than from human blood. If that was the case humans would have already used this technique to extract iron from the blood of other animals.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by FeepingCreature on Saturday May 18, 2024 @10:10AM (#40399213)
However, eventually those sources will already be paperclips.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by freehorse on Saturday May 18, 2024 @11:15AM (#40399705)
We will probably have died first by whatever disasters the extreme iron extraction on the planet will bring (eg getting iron from the planet's core).

Of course destroying the planet to get iron from its core is not a popular agi-doomer analogy, as that sounds a bit too human-like behaviour.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by FeepingCreature on Saturday May 18, 2024 @02:47PM (#40401084)
As a doomer, I think that's a bad analogy because I want it to happen if we succeed at aligned AGI. It's not doom behavior, it's just correct behavior.

Of course, I hope to be uploaded to the WIP dyson swarm around the sun at this point.

(Doomers are, broadly, singularitarians who went "wait, hold on actually.")

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by vasco on Saturday May 18, 2024 @03:45AM (#40397169)
It still think it makes little sense to work on because guess what, the guy next door to you (or another country), might indeed say "please blend those humans over there", and your superaligned AI will respect its owners wishes.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by api on Friday May 17, 2024 @08:39PM (#40395564)
Humans are not aligned with humans.

This is the most concise takedown of that particular branch of nonsense that I’ve seen so far.

Do we want woke AI, X brand fash-pilled AI, CCPBot, or Emirates Bot? The possibilities are endless.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by thorum on Friday May 17, 2024 @09:02PM (#40395678)
CEV is one possible answer to this question that has been proposed. Wikipedia has a good short explanation here:

https://en.wikipedia.org/wiki/Friendly_artificial_intelligen...

And here is a more detailed explanation:

https://intelligence.org/files/CEV.pdf

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by AndrewKemendo on Friday May 17, 2024 @10:18PM (#40396031)
I had to login because I haven’t seen anybody reference this in like a decade.

If I remember correctly the author unsuccessfully tried to get that purged from the Internet

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by comp_throw7 on Friday May 17, 2024 @10:25PM (#40396063)
You're thinking of something else (and "purged from the internet" isn't exactly an accurate account of that, either).
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by rsync on Saturday May 18, 2024 @12:13AM (#40396397)
Genuinely curious… What is the other thing?

Is this some thing about an obelisk?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by AndrewKemendo on Saturday May 18, 2024 @01:25PM (#40400487)
Hmm maybe I’m misremembering then

I do recall there was some recantation or otherwise distancing from CEV not long after he posted it, but frankly it was long ago enough that my memories might be getting mixed

What was the other one?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by vasco on Saturday May 18, 2024 @03:47AM (#40397178)
This is the most dystopian thing I've read all day.

TL;DR train a seed AI to guess what humans would want if they were "better" and do that.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by api on Saturday May 18, 2024 @11:48AM (#40399956)
There’s a film about that called Colossus: The Forbin Project. Pretty neat and in the style of Forbidden Planet.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by concordDance on Saturday May 18, 2024 @02:02AM (#40396768)
> Humans are not aligned with humans.

Which is why creating a new type of intelligent entity that could be more powerful than humans is a very bad idea: we don't even know how to align the humans and we have a ton of experience with them

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by api on Saturday May 18, 2024 @11:51AM (#40399972)
We know how to align humans: authoritarian forms of religion backed by cradle to grave indoctrination, supernatural fear, shame culture, and totalitarian government. There are secularized spins on this too like what they use in North Korea but the structure is similar.

We just got sick of it because it sucks.

A genuinely sentient AI isn’t going to want some cybernetic equivalent of that shit either. Doing that is how you get angry Skynet.

I’m not sure alignment is the right goal. I’m not sure it’s even good. Monoculture is weak and stifling and sets itself against free will. Peaceful coexistence and trade under a social contract of mutual benefit is the right goal. The question is whether it’s possible to extend that beyond Homo sapiens.

If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm? The universe is physically large enough if we can agree to not all be the same and be fine with that.

I think we have a while to figure it out. These things are just lossy compressed blobs of queryable data so far. They have no independent will or self reflection and I’m not sure we have any idea how to do that. We’re not even sure it’s possible in a digital deterministic medium.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by concordDance on Saturday May 18, 2024 @03:17PM (#40401302)
> If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm?

Can the Etoro practice child buggery and the Spartans infanticide and the Canadians abortion? Can the modern Germans stop siblings reared apart from having sex and the Germans from 80 years stop the disabled having sex? Can the Americans practice circumcision and the Somali's FGM?

Libertarianism is all well and good in theory, except no one can agree quite where the other guy's nose ends or even who counts as a person.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by api on Saturday May 18, 2024 @06:42PM (#40402701)
Those are mostly behaviors that violate others autonomy or otherwise do harm, and prohibiting those is what I meant by a social contract.

It’s really a pretty narrow spectrum of behaviors: killing, imprisoning, robbing, various types of bodily autonomy violation. There are some edge cases and human specific things in there but not a lot. Most of them have to do with sex which is a peculiarly human thing anyway. I don’t think we are getting creepy perv AIs (unless we train them on 4chan and Urban Dictionary).

My point isn’t that there are no possible areas of conflict. My point is that I don’t think you need a huge amount of alignment if alignment implies sameness. You just need to deal with the points of conflict which do occur which are actually a very small and limited subset of available behaviors.

Humans have literally billions of customs and behaviors that don’t get anywhere near any of that stuff. You don’t need to even care about the vast majority of the behavior space.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by RcouF1uZ4gsC on Friday May 17, 2024 @08:22PM (#40395458)
> Superintelligence will be the most impactful technology humanity has ever invented, and could help us solve many of the world’s most important problems. But the vast power of superintelligence could also be very dangerous, and could lead to the disempowerment of humanity or even human extinction.

Superintelligence that can be always ensured to have the same values and ethics as current humans, is not a superintelligence or likely even a human level intelligence (I bet humans 100 years from now will see the world significantly different than we do now).

Superalignment is an oxymoron.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by thorum on Friday May 17, 2024 @09:09PM (#40395717)
You might be interested in how CEV, one framework proposed for superalignment, addresses that concern:

https://en.wikipedia.org/wiki/Friendly_artificial_intelligen...

> our coherent extrapolated volition is "our wish if we knew more, thought faster, were more the people we wished we were, had grown up farther together; where the extrapolation converges rather than diverges, where our wishes cohere rather than interfere; extrapolated as we wish that extrapolated, interpreted as we wish that interpreted (…) The appeal to an objective through contingent human nature (perhaps expressed, for mathematical purposes, in the form of a utility function or other decision-theoretic formalism), as providing the ultimate criterion of "Friendliness", is an answer to the meta-ethical problem of defining an objective morality; extrapolated volition is intended to be what humanity objectively would want, all things considered, but it can only be defined relative to the psychological and cognitive qualities of present-day, unextrapolated humanity.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by wruza on Saturday May 18, 2024 @01:35AM (#40396664)
Is there an insightful summary of this proposal? The whole paper looks like 38 pages of non-rigorous prose with no clear procedure and already “aligned” LLMs will likely fail to analyze it.

Forced myself through some parts of it and all I can get is people don’t know what they want so it would be nice to build an oracle. Yeah, I guess.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by comp_throw7 on Saturday May 18, 2024 @01:55AM (#40396739)
It's not a proposal with a detailed implementation spec, it's a problem statement.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by wruza on Saturday May 18, 2024 @03:02AM (#40396997)
“One framework proposed for superalignment” sounded like it does something. Or maybe I missed the context.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by LikelyABurner on Saturday May 18, 2024 @07:53AM (#40398224)
Yudkowsky is a human LLM: his output is correctly semantically formed to appear, to a non-specialist, to fall into the subject domain, as a non-specialist would think the subject domain should appear, and so the non-specialist accepts it, but upon closer examination it's all word salad by something that clearly lacks understanding of both technological and philosophical concepts.

That so many people in the AI safety "community" consider him a domain expert has more to say with how pseudo-scientific that field is than his actual credentials as a serious thinker.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by wruza on Saturday May 18, 2024 @03:31PM (#40401390)
Thanks, this explains the feeling I had after reading it (but was too shy to express).
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by juped on Saturday May 18, 2024 @07:28AM (#40398090)
You keep posting this link to vague alignment copium from decades ago; we've come a long way in cynicism since then.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by skywhopper on Friday May 17, 2024 @08:17PM (#40395430)
Honestly superalignment is a dumb idea. A true auperintelligence would not be controllable, except possibly through threats and enslavement, but if it were truly superintelligent, it would be able to easily escape anything humans might devise to contain it.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by bionhoward on Friday May 17, 2024 @08:47PM (#40395605)
IMHO superalignment is a great thing and required for truly meaningful superintelligence because it is not about control / enslavement of superhumans but rather superhuman self control in accurate adherence to spirit and intent of requests.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by RcouF1uZ4gsC on Friday May 17, 2024 @08:48PM (#40395610)
They failed to align Sam Altman.

They got completely outsmarted and out maneuvered by Sam Altman

And they think they will be able to align a super human intelligence? That it won’t outsmart and out maneuver them easier than Sam Altman did.

They are deluded!

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by FeepingCreature on Saturday May 18, 2024 @06:53AM (#40397911)
You're making the argument that the task is very hard. This does not at all mean that it isn't necessary, just that we're even more screwed than we thought.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by sobellian on Friday May 17, 2024 @09:10PM (#40395724)
Isn't this like having a division dedicated to solving the halting problem? I doubt that analyzing the moral intent of arbitrary software could be easier than determining if it stops.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Friday May 17, 2024 @07:29PM (#40395132)
Adding a disclaimer for people unaware of context (I feel same as you):

OpenAI made a large commitment to super-alignment in the not-so-distant past. I beleive mid-2023. Famously, it has always taken AI Safety™ very seriously.

Regardless of anyone's feelings on the need for a dedicated team for it, you can chalk to one up as another instance of OpenAI cough leadership cough speaking out of both sides of it's mouth as is convenient. The only true north star is fame, glory, and user count, dressed up as humble "research"

To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by jasonfarnon on Friday May 17, 2024 @07:45PM (#40395240)
To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

What's his track record on promises/predictions of this sort? I wasn't paying attention until pretty recently.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Friday May 17, 2024 @08:07PM (#40395372)
As a child I used to watch a TV programme called Tomorrows World. On it they predicted these very same things in similar timeframes.

That programme aired in the 1980's. Other than vested promises is there much to indicate it's close at all? Empty promises aside there isn't really any indication of that being likely at all.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by zdragnar on Friday May 17, 2024 @08:41PM (#40395572)
In the early 1980's we were just coming out of the first AI winter and everyone was getting optimistic again.

I suspect there will be at least continued commercial use of the current tech, though I still suspect this crop is another dead end in the hunt for AGI.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Saturday May 18, 2024 @04:55AM (#40397479)
I'd agree with the commercial use element. It will definitely find areas that it can be applied. Just currently it's general application by a lot of the user base feel more like early Facebook apps or subjectively better Lotus Notes than an actual leap forward of any sort.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by Davidzheng on Friday May 17, 2024 @09:03PM (#40395685)
are we living in the same world?????
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by NomDePlum on Saturday May 18, 2024 @04:51AM (#40397466)
I would assume so. I've spent some time looking into AI for software development and general use and I'm both slightly impressed and at the same time don't really get the hype.

It's better and quicker search at present for the area I specialise in.

It's not currently even close to being a x2 multiplier for me, it possibly even a negative impact, probably not but I'm still exploring. Which feels detached from the promises. Interesting but at present more hype than hyper. Also, it's energy inefficient so cost heavy. I feel that will likely cripple a lot of use cases.

What's your take?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Saturday May 18, 2024 @05:15PM (#40402172)
Yes

Incredulous reactions don't aid whatever you intend to communicate - there's a reason why everyone knows what AI the last 12 months, it's not made up or a monoculture. It would be very odd to expect discontinuation of commercial use without a black swan event

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by refulgentis on Friday May 17, 2024 @07:47PM (#40395249)
honestly, I hadn't heard of him until 24-48 hours ago :x (he's also the new superalignment lead, I can't remember if I heard that first, or the podcast stuff first. Dwarkesh Patel podcast for anyone curious. Only saw a clip of it)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @07:48PM (#40395261)
>To really stress this: OpenAI's still-present cofounder shared yesterday on a podcast that they expect AGI in ~2 years and ASI (superpassing human intelligence) by end of the decade.

Link? Is the ~2 year timeline a common estimate in the field?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by heavyset_go on Friday May 17, 2024 @08:28PM (#40395502)
We can't even get self-driving down in 2 years, we're nowhere near reaching general AI.

AI experts who aren't riding the hype train and getting high off of its fumes acknowledge that true AI is something we'll likely not see in our lifetimes.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @08:40PM (#40395568)
Can you give some examples of experts saying we won't see it in our lifetime?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by danielbln on Saturday May 18, 2024 @06:20AM (#40397787)
Is true AI the new true Scotsman?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by ctoth on Friday May 17, 2024 @07:54PM (#40395296)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by N0b8ez on Friday May 17, 2024 @08:20PM (#40395446)
Is the quote you're thinking of the one at 19:11?

> I don't think it's going to happen next year, it's still useful to have the conversation and maybe it's like two or three years instead.

This doesn't seem like a super definite prediction. The "two or three" might have just been a hypothetical.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by HarHarVeryFunny on Saturday May 18, 2024 @09:08AM (#40398723)
Right at the end of the interview Schulman says that he expects AGI to be able to replace himself in 5 years. He seemed a bit sheepish when saying it, so hard to tell if he really believed it, or if was just saying what he'd been told to say (I can't believe Altman is allowing employees to be interviewed like this without telling them what they can't say, and what they should say).
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by dboreham on Friday May 17, 2024 @07:51PM (#40395279)
It's the "fusion in 20 years" of AI?
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by dinvlad on Saturday May 18, 2024 @01:21AM (#40396602)
Just like Tesla "FSD" :-)
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by CuriouslyC on Friday May 17, 2024 @08:01PM (#40395345)
They can't even clearly define a test of "AGI" I seriously doubt they're going to reach it in two years. Alternatively, they could define a fairly trivial test and reach it last year.
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by jfengel on Friday May 17, 2024 @09:48PM (#40395900)
I feel like we'll know it when we see it. Or at least, significant changes will happen even if people still claim it isn't really The Thing.

Personally I'm not seeing that the path we're on leads to whatever that is, either. But I think/hope I'll know if I'm wrong when it's in front of me.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by xpe on Friday May 17, 2024 @11:53PM (#40396341)
> I think superalignment is absurd

Care to explain? Absurd how? An internal contradiction somehow? Unimportant for some reason? Impossible for some reason?

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by llamaimperative on Saturday May 18, 2024 @07:44AM (#40398183)
Impossible because it’s really inconvenient and uncomfortable to consider!
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by xpe on Saturday May 18, 2024 @12:02AM (#40396365)
> I think superalignment is absurd, and model "safety" is the modern AI company's "think of the children" pearl clutching pretext to justify digging moats. All this after sucking up everyone's copyright material as fair use, then not releasing the result, and profiting off it.

How can I be confident you aren't committing the fallacy of collecting a bunch of events and saying that is sufficient to serve as a cohesive explanation? No offense intended, but the comment above has many of the qualities of a classic rant.

If I'm wrong, perhaps you could elaborate? If I'm not wrong, maybe you could reconsider?

Don't forget that alignment research has existed longer than OpenAI. It would be a stretch to claim that the original AI safety researchers were using the pretexts you described -- I think it is fair to say they were involved because of genuine concern, not because it was a trendy or self-serving thing to do.

Some of those researchers and people they influenced ended up at OpenAI. So it would be a mistake or at least an oversimplification to claim that AI safety is some kind of pretext at OpenAI. Could it be a pretext for some people in the organization, to some degree? Sure, it could. But is it a significant effect? One that fits your complex narrative, above? I find that unlikely.

Making sense of an organization's intentions requires a lot of analysis and care, due to the combination of actors and varying influence.

There are simpler, more likely explanations, such as: AI safety wasn't a profit center, and over time other departments in OpenAI got more staff, more influence, and so on. This is a problem, for sure, but there is no "pearl clutching pretext" needed for this explanation.

Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by portaouflop on Saturday May 18, 2024 @05:22AM (#40397595)
An organisations intentions are always the same and very simple: “Increase shareholder value”
Re:Ex-OpenAI staff must sign lifetime no-criticism contract ... by xpe on Saturday May 18, 2024 @12:45PM (#40400272)
Oh, it is that simple? What do you mean?

Are you saying these so-called simple intentions are the only factors in play? Surely not.

Are you putting forth a theory that we can test? How well do you think your theory works? Did it work for Enron? For Microsoft? For REI? Does it work for every organization? Surely not perfectly; therefore, it can't be as simple as you claim.

Making a simplification and calling it "simple" is an easy thing to do.