News for hackers. Stuff that matters.
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by throwaway290 on Saturday November 18, 2023 @10:12AM (#38320449)
> AI, over the long term, will render humans mostly useless.

This statement is nonsensical. Unless you consider the end goal to be something other than humanity, which is obviously silly if you give it 5 minutes of thinking, various applications of ML can be either helpful or harmful but it cant make humans useless any more than a electricity and its application as washing machine can make clothing wearers useless.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by piva00 on Saturday November 18, 2023 @10:38AM (#38320689)
I understood from the comment, given the remark of "over the long term", the meaning over decades/centuries/millennia.

Which isn't that nonsensical, if an AGI is created and follows similar processes as humans to acquire knowledge, skills, etc. it is a quite logical conclusion that it will be able to render humans useless: a very advanced AGI can imagine and develop technologies just like we do, it can direct resources and machinery to build whatever it creates, including self-replication, given access to resources it can potentially render humans useless.

That's at least what I interpreted from the comment.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by strogonoff on Saturday November 18, 2023 @12:19PM (#38321880)
No technology can render humans useless, since technology is the “how” whereas humans are the “why”. Technology can be seen as good/bad/neutral to humans in some ways, but rationally speaking—religious views aside—humans cannot logically be qualified in those terms with respect to technology.

One could say some future technology might be so good that humans need to do almost nothing in order to survive. Perhaps that’d pose some challenges in terms of mental health, but that is a very different issue, assuming it would be a issue at all (and assuming such technology is even possible in theory).

One could say some advanced technology could go out of control, or magically acquire self-awareness and agency (same thing in a philosophically dubious wrapper), or (more prosaically) be (intentionally or not) misused by humans so that it harms humans, but that just puts it into the bad category.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by piva00 on Wednesday November 22, 2023 @07:36PM (#38387509)
I think where we diverge is that you are assuming we will be in control of such technology. I'm in the camp which doesn't think we would be really in control of a superhuman intelligence.
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by strogonoff on Thursday November 23, 2023 @12:11PM (#38394957)
Well, in that scenario I stand by my comment: if there is some technology that humans are in control of at all (as in, it literally performs in ways we are unable to predict), then it is simply harmful (because no ability to predict could significantly complicate things like survival). However, crucially, in no scenario it can make humans useless.

That said, I do doubt it is likely. What is much more likely is that, more prosaically, some humans will misuse the technology and harm other humans; a story as old as civilisation itself.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by BobbyJo on Saturday November 18, 2023 @10:56AM (#38320891)
Even if AGI was strictly human level, you'd have human level intelligence that was immortal, never got tired, and was instantly replicatable. Could you compete with a human that never needed sleep, had been studying for decades or centuries, and could make copies of itself on demand? I couldn't.
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by mikeravkine on Saturday November 18, 2023 @11:09AM (#38321033)
Why would you need to compete with such an entity? What does "compete" even mean here? Can't instead everyone get one (or 10) of these to.. assist them? I don't understand why we are jumping directly into dystopian scifi vs what past tool revolutions actually look like.
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by Jcowell on Saturday November 18, 2023 @12:03PM (#38321652)
who’s going to give everyone one? How? In what world does AGI not end up being in the hands of corporations , wiping out jobs, causing mass unemployment before governments have the ability to enact effective legislation?
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by BobbyJo on Saturday November 18, 2023 @12:11PM (#38321777)
If you have 10 "assistants" who are smarter than you, what are you actually doing that would take more than 5 minutes of your time? How could you convince yourself you're still necessary in that situation?
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by throwaway290 on Saturday November 18, 2023 @12:27PM (#38321952)
Surely it's been a reality for years world over that stupider people end up occupying higher positions. One can have 10 subordinates each 10x smarter than the higher up and all that happens is subordinates get 100x work and the higher up in question gets a promotion. But remember that this is bad analogy because it is talking about humans and assistants have basic human stuff like rights and feelings and self awareness just like their boss.

If we are talking about some software tool, you can't be unnecessary because the tool exists for you not the other way around. If your tool starts occupying your place in life, getting all the praise, taking away your job, taking away all your purpose of life, living in your family, parenting your children, taking care of your parents, sleeping with your wife (OK I'm joking at this point) then maybe the tool is harming your human rights, bad tool should be banned. Maybe someone who runs this tool now gets paid more and they should answer to the law. Maybe they even trained this tool on your data and you didn't think to object back then.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by BobbyJo on Saturday November 18, 2023 @12:45PM (#38322175)
Im not actually sure what you're trying to say here. Your first paragraph seems to suggest people with smarter assistants are indeed deluding themselves by thinking they're necessary. The second suggests you cant be unnecessary because we wont want AGI helping in our homes?

If you want to take care of your parents and do stuff in your home yourself, why would AGI force you not to? Id classify that as entertaining yourself. With purpose sure, but still.

Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal? by throwaway290 on Sunday November 19, 2023 @04:30AM (#38330858)
You are only confused if you can't distinguish tech and humanity

> people with smarter assistants are indeed deluding themselves by thinking they're necessary

If they were not necessary then they would not be in a higher up position would they?

> If you want to take care of your parents and do stuff in your home yourself, why would AGI force you not to?

Yes. You can't be rendered useless by tech if tech is there for your benefit. (Though you can be harmed by tech if it is harmful or someone uses it against you for own benefit as part of obsolete dog eat dog society dynamic.)