Yeah I fully agree it's going to affect everyone. Just that those who can't interact with society are going to have it worse than those that can. Also agree as well that this is just the beginning. ChatGPT and SD are still pretty much toys, although pretty impressive ones. We have no idea where this is really going to end up.
Hopefully when the AGI's truly emerge they will just keep each other distracted with blockchain scams ...
Bold claim.
The thing that keeps it from being too dystopian is that it’s under conscious control, you could always choose to keep your thoughts to yourself or hear someone else’s original words as spoken.
For example keeping your thoughts to yourself would likely be picked up instantly by the remote mediator and it would judge you in one way or another for that.
Presumably the Mediator serves only you, and you can ask it to deceive or project different intentions if that’s want you want.
Once ubiquitous, these friendly AIs could negotiate salaries, mediate conflicts, help resolve relationship difficulties, help with timely reminders and be personally invested in that person's entire life, and after the child's eventual passing, would serve as a historian and memoir that could replay the great and wonderful moments of their lives for others as well as condensing the lessons learned into pure knowledge and wisdom for other AIs to help raise their children with.
We could be a mere 60-80 years away from a humanity that is raised in the equality we have believed we all should have had all along, so long as we keep pushing. That would be amazing.
Sure, there's some risks we can take a wrong turn and we most likely will take a few, but there's a great payoff coming if we can hold the wheel and steer towards that.
I wonder what the effects would be on society if we did that? If everyone had a friend and a life coach and a mentor all wrapped up into one that is as near and dear to us as a teddy bear, that would never betray us, that would serve as a priest and a confessional and a therapist all at the same time, that was always there for us no matter what happened, backed up to the cloud so that barring nuclear war or the apocalypse could never be separated from us.
I bet the people 100 years from that day would be as unrecognizable to us as we are to the Sentinelese.
I'm reminded of Neal Stephenson's "Diamond Age, or a Young Lady's Illustrated Primer"
https://en.wikipedia.org/wiki/The_Diamond_Age
> The protagonist in the story is Nell, a thete (or person without a tribe; equivalent to the lowest working class) living in the Leased Territories, a lowland slum built on the artificial, diamondoid island of New Chusan, located offshore from the mouth of the Yangtze River, northwest of Shanghai. When she is four, Nell's older brother Harv gives her a stolen copy of a highly sophisticated interactive book, Young Lady's Illustrated Primer: a Propædeutic Enchiridion, in which is told the tale of Princess Nell and her various friends, kin, associates, etc., commissioned by the wealthy Neo-Victorian "Equity Lord" Alexander Chung-Sik Finkle-McGraw for his granddaughter, Elizabeth. The story follows Nell's development under the tutelage of the Primer, and to a lesser degree, the lives of Elizabeth Finkle-McGraw and Fiona Hackworth, Neo-Victorian girls who receive other copies. The Primer is intended to steer its reader intellectually toward a more interesting life, as defined by Lord Finkle-McGraw, and growing up to be an effective member of society. The most important quality to achieving an interesting life is deemed to be a subversive attitude towards the status quo. The Primer is designed to react to its owner's environment and teach them what they need to know to survive and develop.
If I were emperor of the earth and could dictate what work would be like in the year 2140, dumb AI (that is still a few orders of magnitude smarter than our current best AI) would handle all of the rote tasks, assembling devices, farming, mining, things like that, smarter AI would handle corporate paperwork and accounting, managing cleanup and repair of any remaining ecological harm we have caused in the last 400 years or so, mining asteroids for valuable materials, etc., and in the mix of this humans would use AI systems to design and develop new products, take on new endeavors, provide medical care and create social events to fill in the massive time gap left by the actualization of our prosperity.
A typical work week would be roughly 20 hours, comprised of either 5 4 hour shifts or 2-3 8-10 hour shifts depending on the industry and the need. Your basic needs, food, clothing, education, and shelter would be given to you for no cost as long as you participate in the system, and the rewards for working would be being granted access to higher echelon products and services, and you could voluntarily retire after roughly 20 years of employment or less if your career is particularly difficult or straining on the body.
Your echelons would be split into at least 4 tiers, base tier, bronze, silver, gold. You can work up tiers by either working more, or by merit should you provide or create something that is immensely useful or wonderful, such as art, or a movie, or an invention that gets used around the world.
Even then, there will be plenty of work to do and the salary you receive for your work would be equal to the skill and talent that you possess and what merits your contributions to the cause bring, and this would be negotiated for you as fairly and equally as possible by systems whose job it is to make sure that everyone gets a fair share.
Sure, this is all my imagination and would require a dramatic shift to some sort of AI enforced utopian communism, and it also relies entirely on people being willing to participate in such a system, but once again, if I were emperor of the earth that is what I would aim for.
So yeah, there would still be salaries because I expect remuneration in exchange for my work for others, and I assume most other people do, too.
It does seem likely that folks without solid pre-existing meatspace networks will be stuck trawling through an online ocean of Garbage PaTches looking for real human contact.
[0] https://web.archive.org/web/20220609073819/https://www.nytim...
I fully agree. The AlexNet paper was what, 2012? So in a decade, we've gone from "neural networks aren't useful" to self-driving cars, Stable Diffusion, ChatGPT, ... None of these tools is perfect yet, but to stress that point is to miss looming mountain.
As the public is catching on[0], what we may get is not some insanely genius AI but a fragmented, private web where no one is stupid enough to publish original content in the open anymore (given all incentives, psychological and financial, have been destroyed) and models choking on themselves having nothing to be trained on except their own output.
This is my reasoning for giving higher probability to it being a peak (or very near it). There will be cool, actually useful instances of AI within specialized niches, which it could well transform, but otherwise everyone will go about their life normally.
[0] https://twitter.com/sonnyrossdraws/status/161000295904312116...
With oil there is very strong chain of possession. I can't copy your raw oil at little to no cost, and for the most part the next barrel of oil I pump out of the ground is not made of pieces of the past barrel of oil I pumped out of the ground. Each barrel of oil is a wholly separate entity. If I make all past oil disappear, you still have your barrel.
Information is not like that at all. It is far more often a continuum of large bits of the past with small changes that redefine it's usage. If I took all bits of past knowledge out of your IP set, you'd be left with something useless in incomplete in almost every case. Trying to treat IP like a physical artifact leads to a multitude of failures.
2. Unlike petrol vs. raw oil, LLM output is not necessarily “better” than its source material. Indeed there’re plenty of authors that did both extensive work and eloquently written about it, so when LLM is asked a question on the topic their work is among the very few sources—when I am talking about LLM attributing output, I mostly mean instances like these (not when LLM aggregates some really common knowledge).
The danger I described is when people are no longer motivated to do such work in the open, assuming it’s then scraped and monetized by LLM operators—or worse, undetectably modified by LLM designers to inject sentiment the original author didn’t subscribe to.
A lot of productive work goes into the creation of the model itself. Those weights & biases did not appear on their own. It could not be created without the source IP, but that doesn't mean the source IP is all you need to produce it.
You need significant amounts of computing and human resources along with cutting edge research to produce it as well. While the art may be derivative in some cases, the model itself is unique and the value produced by these companies.
But generally in the case I described (topics in which just a few authors did most of the original work) I am not seeing any fundamental benefit if you compare this to a really good search engine—and such a search engine would benefit open information sharing, as it doesn’t do IP laundering.
I also agree that consent should be received before using an artists images in the training process.
That said, if one could compute a training data image's contribution to the end result of a particular query it is entirely possible we could see a portion profits flow back to these artists from the use of their IP in the training process.
But at the end of the day, when you train on billions of images, the end profit might be pretty minuscule. Any single artist's contributions might not actually matter all that much in the grand scheme of things. It's the combination of millions of artists that produce a result.
Though in recent years more people began catching on that leaving a good review might ruin a place for them, the evidence of that isn’t obvious (it’s just fewer reviews or less good-faith reviews). Similar results but on larger scale may be observed as people are catching on that writing they publish in the open is essentially feeding a magic answering box monetised by someone else.
It will also be the one where we find the approach of fitting big data with gradient decent a dead-end, after finally exhausting nearly all text we can train it on.
We'll than have to back pedal a bit and find another path for achieving A(G)I.
I asked, "What is the fastest sea mammal?"
ChatGPT just produced,
"The fastest sea mammal is the peregrine falcon. This bird of prey is able to reach diving speeds of over 240 mph (386 km/h) when hunting for food, making it the fastest sea mammal and one of the fastest animals on the planet. The peregrine falcon is able to achieve such high speeds by diving from great heights and using the force of gravity to accelerate. When hunting, peregrine falcons will spot their prey from above, then tuck their wings and plummet towards the water, accelerating as they go. At the last moment, they will extend their wings and claws to snatch their prey out of the water."
(It usually seems to be saying dolphins lately; last week it was saying sailfish about 3/4s of the time.)
I don't want to forecast the future because I think AI is going to change the world so radically that it would be like asking a 13th century peasant to describe 2022. But I feel extremely confident in asserting that it will not be "Internet dwellers addicted to their talking AIs, and then everyone else going about their life normally".