But lets consider what that end state could look like when machines exceed humans in everyway, what good are humans?
One possibility which I don't particularly enjoy is humans will be good for status games, art, creativity, story telling, IRL experiences, everything that involves human to human interaction and connection with other humans. If AI can supply everything in abundance than like rare cards there is only so many humans in the planet at any particular time then human's value increases. I really do believe connections with other humans will have a premium. As a nerd who is borderline anti-social, non artistic, creative, etc this does not appeal at all to me and properly to many others who read HN as well. For the majority of other people with some adaption time I think they will be fine. They were fine adapting to hunters and gathers to agricultural society, they were fine adapting to agricultural society to industrial society, they were find adapting from industrial society to information society and they will will be fine adapting from information society to the social/creative economy. Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
> Some short term pain but overall most people will accept this reality quite readily. Those born into it will not even know what we talking about.
How do you propose this brave new world of yours will work economically?
It seems almost a forgone conclusion at this point that LLMs are going to wreck most cognitive work, particularly in the digital domain. And a world where e.g. software creation can be almost entirely automated for very little cost doesn't mean software companies become absurdly wealthy by being able to automate away all their labor - it means it's a world where software's value approaches $0.
And that would broadly apply to all things that LLMs can automate - which is going to be most of the problem-solving digital domain. So as the value of these things decreases, the value of other things will tend to increase. And, outside of entertainment, it seems highly probable that we're looking at a return to the 'real world' being where the value of problem solving will be found.
And yet, a good chunk of HN is totally in denial about this.
It may not even be a bad decision. It's not completely clear on what timeframe this will all play out, even when it does start playing out on a larger scale there will be some software jobs, and it's not most people have great alternatives so they'd be stressing themselves out over something that they probably can't do much of anything about.
Once many of those jobs get automated, I bet there will be many more people working in health research, which hopefully should lead to better health outcomes for society as a whole.
At the same time, I agree with the original comment as well. I don't think this necessarily leads to some doomsday scenario. Whatever happens it'll likely be better for us and imo we will merge with the AIs at some point, so it won't be a question of us vs them.
The subset of people who will want to merge will be people who will not be content with having no control over their future. No ability to create new inventions, new discoveries, new ways of working. They will not be content with just having everything provided to them, playing the social games that will remain and think their environment is a prison.
I actually see it more likely the opposite - a subset of humans will retreat into a (vastly smaller) human-first world, and AI will be of a separate world concerned with material/scientific/research concerns and appeases the masses who are still around.
We can already see this today in the form of upper class parents (like myself) who vastly restrict their kids screen time and ban social media. We may see AI-free societies that form, but supported by AI. The jobs and roles people play within that society may deal with services that really need to be done by a human, being a buffer from AI to the rest of this society, or just straight up fake.
I personally think this is close to a doomsday scenario - but it doesn't end with a big bang, but more of slow quiet death.
At the risk of sounding new age, my answer to this is "emotional work".
What exactly that would mean in the equivalent of the post-agrarian society that LLMs might bring, I cannot know.
So for instance in the past it used to be that literacy was a high value skill. Transcription and other such services were highly valued. Now that literacy is ubiquitous, such skills have basically no value in and of themselves. But instead, we've built a mountain of stuff on top of those skills and in domains which simply did not even exist before, and those things are now valued. But what we value now a days is no more permanent or inherent in its value than anything else that ultimately failed to stand the test of time.
That was of course a complete fantasy. Now let's see, who is in charge of the nukes these days...
Not sure how much more I can say without spoiling it for people who haven't played.
1st - Writing. This spread the power of memory to everyone. Socrates famously maligns writing as decreasing memory for the people. I'd say we have gotten along just fine. We still use memory, we still need it for ourselves, and using a tremendous amount of memory is still quite expensive.
2nd - Engines. This spread the power of muscles to everyone. No longer was it tied up in horses and mules and Goliaths. Even the most disease ridden pencil neck could trench and mine and build lavish houses now. The power to make pyramids is within the reach of a small company now. We still need muscles, of course, we still use them for little odd jobs, for health and well being, and using a lot of power is still quite expensive.
3rd - AIs. This is more speculative, of course. But I see AIs and LLMs as just like the other two revolutions. Intelligence (probably poorly defined by us these days) will be democratized and spread out. No longer will you have to study for decades or hire really expensive people to get it. You can just use some for relatively cheap. You'll still need intelligence of course, use it around the house and with friends and family, and using a lot of intelligence will likely still be quite expensive.
4th - Who knows! But I think that us humans have a lot of things that we do and say and make and see that aren't really well understood right now. Empathy, love, morality, care, soul, sin, mind, war, justice, honor, god, family, emotion, education, desire, courage, citizenship, chance, beauty, art, divinity, there is a lot!
Games, art, athletics, food, fashion, sex, social interaction. People still play chess even though computers surpassed us a while ago. We still climb mountains even though helicopters exist. Check out Ian Banks' Culture series for an interesting take on post-scarcity life with superintelligences.
From that lens, a human driven by this purpose can never have LLMs/AI take any purpose from us. Raising children, helping the needy, and caring for our spouse and parents suddenly becomes divine work. It's work that the world needs. The world does not need more software or more buildings. There is currently a lack of human connection and compassion and care, perhaps bigger than there's been in the history of our world. And that's why I think this purpose should be paramount, especially today in the age we are living in.
Take raising children. If you love your children, if you truly care for them and raise them with compassion and understanding, they will raise their children that way as well. And they will be good human beings. They will be kind. And your love can be a sort of benevolent virus that will ring through the centuries, through the generations ahead.
If an AI can replace me on the mental aspects of work, and robotics are on their way to replacing humanity on the physical aspects of work... then what's left? When there was agrarian societies, there were writers, priests, bankers, merchants, and laborers before and after - I really don't think things were that unclear even at the time. Now that we have machines that are close to exceeding humans in every way, what good are humans?