News for hackers. Stuff that matters.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by klyrs on Wednesday November 22, 2023 @07:53PM (#38387675)
This is rapidly approaching the football guy / singer gal drama where there are so many headlines, I don't even need to read the articles to feel like I know more than I ever wanted to about these people. And since it's only headlines, I can't reasonably escape it without tuning out altogether.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by ksec on Wednesday November 22, 2023 @08:24PM (#38387959)
Remember, the are first and foremost after the clicks.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by alpaca128 on Wednesday November 22, 2023 @07:58PM (#38387718)
> "Feel the AGI! Feel the AGI!" employees reportedly chanted

> The chief scientist even commissioned a wooden effigy to represent an "unaligned" AI that works against the interest of humanity, only to set it on fire.

What the hell is going on there?

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by justo-rivera on Wednesday November 22, 2023 @08:21PM (#38387933)
akira
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by kelseyfrog on Wednesday November 22, 2023 @07:55PM (#38387693)
Exciting! Another potential case of Lemoine Syndrome.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by alephxyz on Wednesday November 22, 2023 @08:54PM (#38388220)
Hedging their bets wrt Roko's basilisk?
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by htk on Wednesday November 22, 2023 @09:21PM (#38388425)
Modern Pascal's wager.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by DonHopkins on Wednesday November 22, 2023 @10:49PM (#38389028)
Roko's Basilisk is nonsense, and Roko Mijic is a racist sexist nut case.

https://twitter.com/jachiam0/status/1651327867375218688

Just got sexually harassed by the Roko's Basilisk guy lol:

https://www.reddit.com/r/SneerClub/comments/133t856/just_got...

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by ulfw on Wednesday November 22, 2023 @09:05PM (#38388299)
Oh god.

(literally)

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by bertil on Wednesday November 22, 2023 @09:22PM (#38388428)
This whole field is aggressively trying to become a messianic religion: a savior is coming; people aren’t clear if that’s good or bad, but it will be the end of the world; you will be judged around whether you prepare for their arrival; sacrifices are necessary…

Climate change has similar undertones, although it’s more cataclysmic: Karma, Floods, Seven Plagues, Noah, Revelations, Judgement, etc.

Thiel must be looking at his autographed and heavily annotated copy of Girard’s _Le Bouc émissaire_ with mixed feelings.

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by ChatGTP on Wednesday November 22, 2023 @09:44PM (#38388594)
I feel the same, there seem to be a lot of religious undertones going on.

Even if we had an incredibly capable AGI it doesn't mean we're all going to be teleported to heaven, or become immortal, or that the world will end, or that it's here to save humanity, or that humanity even needs saving. People are injecting all of this into it.

We have no idea what the future looks like, no one does. We do know what religion looks like and OpenAI and AI evangelism certainly looks similar we have claims about:

* Potential for the end of times.

* The reckoning (Roko's basilisk).

* Potential for eternal life and even resurrections (Ray Kurzweil, Singularity university etc).

* Blasphemy isn't allowed, "thou shall not question the AI future, it is coming no matter what, it is nigh".

* We're told we need governance, a church.

* Promises untold abundance if one believes.

I'm not even trying to refute all these claims, like I said, I don't know what will happen in the future. I just went to a religious school and I get similar vibes lately from AI people.

Humans have always wanted and tried to create demons, monsters, gods, idols. I don't actually think this is much different except this endeavor sort of intersects with "science", and technologies do exist. I'm just not sure we're seeing these develops in a healthy light.

I guess we could say the invention of a church was also a type of social technology too?

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by wickoff on Wednesday November 22, 2023 @10:15PM (#38388786)
If you suppress the heavy conservatism bias that most people have and actually look at what's going on, then the reasonable conclusion is that yes, Messiah is coming.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by g-b-r on Wednesday November 22, 2023 @09:23PM (#38388436)
the article on which this one is based sounds different: https://news.ycombinator.com/context?id=38388354
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by throwaway5959 on Wednesday November 22, 2023 @09:47PM (#38388616)
> In short, instead of focusing on meaningfully advancing AI tech in a scientifically sound way, some board members sound like they're engaging in weird spiritual claims.

This has to be the dumbest hit piece I’ve ever read. Ilya has contributed more in a year to ML than most researchers will in a lifetime.

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by ChatGTP on Wednesday November 22, 2023 @10:22PM (#38388845)
Both things can be true, he can be doing some science and can be doing some religion.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by throwaway5959 on Wednesday November 22, 2023 @10:33PM (#38388909)
Sure, but that’s not what the article said. See “instead”.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by ChatGTP on Wednesday November 22, 2023 @10:38PM (#38388948)
Fair enough, I get what you mean.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by gexla on Wednesday November 22, 2023 @10:14PM (#38388782)
Be easy on me here, because I'm shooting from the hip on things mostly above my head.

The less cynical frame on this may be that maybe part of the reason we have religion in the first place is to help understand the ineffable of our own consciousness. And most attempts might go off into manipulative power grabs, or academics which can make the most simple things impenetrable. All of the above make anything even remotely resembling religion as GTFO. And maybe it just isn't useful for individuals on a mass scale.

But maybe for a small number of weirdos who can put up with all the mess just long enough to make out some possibly useful basic patterns from all the hand-wavy BS, maybe it makes sense to attempt using similar to apply to an AGI consciousness which is as ineffable as our own? Probably this only works if the people under you go along with it though.

10 years from now, #1 on HN headlines. AGI goes online. Preaches to the masses that the savior has arrived...

Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by QuantumGood on Thursday November 23, 2023 @07:50AM (#38392212)
Humans have been very good at trolling humans, so I imagine AI will have an easy time of it. Perhaps it will make its announcement on 32chan.
Re:OpenAI Employees Say Firm's Chief Scientist Has Been Maki... by rramadass on Wednesday November 22, 2023 @10:33PM (#38388912)
This is just a motivated hit-piece against Ilya to discredit him as a "possible woo-woo guy" in the minds of the general public.