News for hackers. Stuff that matters.

A comment on Sam Altman's ouster was precipitated by letter to board about AI breakthrough. Parent comment

Re:Sam Altman's ouster was precipitated by letter to board a... by slibhb on Wednesday November 22, 2023 @07:18PM (#38387317)
That's an interesting argument. I suppose I would expect a superintelligent AI to lack goals. Or perhaps the smarter it is, the fainter its goals would be.
[ Parent | on HN ]
Re:Sam Altman's ouster was precipitated by letter to board a... by dr_kiszonka on Wednesday November 22, 2023 @10:57PM (#38389078)
If LLM-based AGI is essentially made out of human thoughts put down in writing, then transcending our nature and values would possibly require a big leap. Perhaps this big leap would take the AGI a second, perhaps longer. And it would be a double-edged sword. We would want it to not have goals (in case they are incompatible with ours), but we would want it to value human life.

I love Star Trek, but I hope we don't have to deal with AGI for the next hundreds of years.

[ Parent | on HN ]