There's a great tech demo a dev did a year or two ago showcasing GPT-3, speech-to-text, and text-to-speech to have random NPCs in a VR open world respond to anything the guy said if he walked up to them and talked to them.
Procedural generation has taken on almost a "dirty word" reputation in the past few years in gaming, but as AI continues to allow for exponential variety at increasingly high quality, it's going to enable some truly mind boggling experiences.
Expect to see MMO models (subscription fee and server-oriented) but for single-player instanced worlds dynamically generated around your interactions in them.
I can't wait to have a party of friends to go on epic adventures with that are all just AIs I picked up across a world along the way.
Less than 20 years away, and possibly even less than 10.
When I played with it, I started a quest as a wizard looking for a book.
I was able to cast a tracking spell that led me to a giant library.
I could have it read the titles of the books on a shelf in front of me.
I could pick up any book and open to a random page and have it tell me what was in it.
One was about a little half-elf that had a magic flute that broke.
I cast a summoning spell to summon the half-elf and fix its flute, after which it happily played a song opening a door to another dimension filled with musical instruments.
Give me that level of emergent gameplay in a VR open world, and then just take my money and all my free time, as I'm never leaving.
We're simply very, very early on in what's arguably going to be the most transformative tech since the Internet. People predicted back then that the slow network which only offered basic things like email wasn't going to significantly disrupt things like retail.
They were only right in that it didn't remain slow and ended up doing a lot more than email.
This stuff is getting better way faster than any tech I've seen, and I used to consult for CEOs at Fortune 500s and sit on advisory boards on the topic of emerging tech.
I wouldn't be so quick to bet against it. We really haven't even started to see what these models can do in application.
Like what?
I should preface by saying I think art is great, I know a lot of artists who struggle to make a living, and it is somewhat heartbreaking to think of all the poor art students who I guess we should pay for their educations and will never have careers now?
There are highly competent artists that can create highly convincing copies (fabrications? forgeries?) of famous paintings. Are these paintings worth anything? No, because people find value in the specific contribution to the field of art that the particular painting represents.
I think we should look at DALL-E 2 like a highly competent artist that can produce convincing forgeries and even mimic the style of famous artists, but cannot replace the artists themselves.
We don't know that. DALL-E must encode its knowledge about art styles somewhere in a way which permits applying them to almost arbitrary contents, similar to style transfer. So, what do you get when you 'just interpolate' between artists in the high-dimensional space defined by a multi-billion parameter model? It is vanishingly unlikely that that point in the style latent space will correspond to the output of any artist who has ever lived. What if you manipulate the encoding to push it far away from the latent points of a large set of real artists? And so on. We don't know what that looks like or if the new styles would not be considered 'original' by critics unaware of the machine origin.
How does this benefit society? Even in the case the artist themselves uses the generator, is the artist better off for no longer needing to create art? It's not like there is an economic advantage, and so there isn't as much incentive to create even original art anymore, someone can just immediately mimic it.
People mimicked art in past, but at least for the artist there was the value of honing their own skill, and remixing or enhancing it, maybe tools like this have the potential to destroy creativity itself.
Also, like, this is how the world works. To cite a hackneyed example, people who worked with horses had to figure something out when new tech displaced them. So will graphic designers, illustrators, et al, if indeed AI is a more competitive option for their services.
Simple automations can be driven by GPT-3 as well. It needs a representation of the screen and it will automate the task described in natural language.
Of course defining art is a subject in itself, but I think that being afraid of AI replacing artists is comparable to thinking photography would when it was invented.
Human insight and imagination will always be needed to create meaningful, useful prompts
I'm hopeful but skeptical at the same time.
Why are we focusing on image generation as the target for AI automation? It's not like there is a shortage of artists, expect perhaps amongst programmer bros. Why are there no efforts to automate away positions such as executive offices? Are CEOs so much difficult to replace than artisans?
"I invented a method to kill people, what are supposed to halt progress because more people die now? I hate it when people bring up that I'm a serial murderer".
There are things I would be doing with AI and things I would not. Being happy about making a even just a particular type of art redundant, well it if it doesn't benefit anyone then why would you care?
Besides, we have banned certain types of research before, precisely because we decided they weren't ethical. Your argument for "progress" is a poor one.
Sure it is, and sure we do. There are ethics in AI boards for a reason at the major AI research companies, as well as many other technology-producing companies.
> Why are we focusing on image generation as the target for AI automation?
Who is "we?" Individual researchers focus on what they want because they like that topic of research. There is no committee out there who figures out, "what industry can we put people out of jobs this week?" No one wakes up thinking, "oh boy, time to put artists out of work."
> Why are there no efforts to automate away positions such as executive offices?
There are. See abstract thinking AI research.
> Are CEOs so much difficult to replace than artisans?
Yes? Abstract reasoning, allocation of abstract resources like engineers (not widgets or manufacturing) is not an easy task to create an AI for, if a CEO is automated then that means we've reached artificial general intelligence. In contrast, like you see with DALLE and others in this link, art is much easier to automate. This doesn't even get to the notion of artists being in a surplus, they choose to do art as their livelihood. Now, you could ask whether it's fair and whether we need a UBI or something like that, but that's a different question entirely.
> "I invented a method to kill people, what are supposed to halt progress because more people die now? I hate it when people bring up that I'm a serial murderer".
Funny you say that because the military has invented many things that are now used in civilian life [0]. Even the smartphone you use is in part due to their innovations. This is not even to bring up nuclear weapons, which while horrific, have effectively been used as MAD, not to mention a highly efficient energy source via nuclear energy.
> There are things I would be doing with AI and things I would not. Being happy about making a even just a particular type of art redundant, well it if it doesn't benefit anyone then why would you care?
You don't speak for everyone. Why wouldn't automating image or video generation be beneficial to "anyone?" I could imagine at least several use cases off the top of my head, such as a unique streaming service for every individual. Artists themselves can also be influenced by such media, it's not like they stopped after photography was invented. Art just changed.
> Besides, we have banned certain types of research before, precisely because we decided they weren't ethical. Your argument for "progress" is a poor one.
Perhaps we shouldn't be banning research just because of some subjective morality. You've shown no argument for why "progress" is a poor incentive, merely that you personally don't know or care enough about it.
And one more thing, art isn't done as a livelihood, it's done because the artist has a deep appreciation for the works they want to create. That some do it as a money-making endeavor is immaterial to this fact.
[0] https://en.wikipedia.org/wiki/List_of_military_inventions
Now imagine joining this with dall-e and you truly have a game which has never existed until now, with it's own story and graphics that you are creating on the spot.
Unlike the adventure games like King's quest where everything was pre-programmed, this is truly infinite never-ending game with a unique experience for every single player.
Like the guy from the '2 min papers': what a time to be alive. I feel so happy and excited just thinking about the possibilities these techs are going to bring.