News for hackers. Stuff that matters.
Re:How DALL-E 2 Works by superasn on Tuesday April 19, 2022 @01:44PM (#31086322)
Gaming is going to get so interesting with these emerging technologies. I played A.I. dungeon sometime ago and I was amazed at how good it was at making up believable stories on the fly.

Now imagine joining this with dall-e and you truly have a game which has never existed until now, with it's own story and graphics that you are creating on the spot.

Unlike the adventure games like King's quest where everything was pre-programmed, this is truly infinite never-ending game with a unique experience for every single player.

Like the guy from the '2 min papers': what a time to be alive. I feel so happy and excited just thinking about the possibilities these techs are going to bring.

Re:How DALL-E 2 Works by kromem on Tuesday April 19, 2022 @06:48PM (#31090389)
Yeah, it's getting to the point I'm starting to see current game design as getting long in the tooth by comparison to what I know is ahead.

There's a great tech demo a dev did a year or two ago showcasing GPT-3, speech-to-text, and text-to-speech to have random NPCs in a VR open world respond to anything the guy said if he walked up to them and talked to them.

Procedural generation has taken on almost a "dirty word" reputation in the past few years in gaming, but as AI continues to allow for exponential variety at increasingly high quality, it's going to enable some truly mind boggling experiences.

Expect to see MMO models (subscription fee and server-oriented) but for single-player instanced worlds dynamically generated around your interactions in them.

I can't wait to have a party of friends to go on epic adventures with that are all just AIs I picked up across a world along the way.

Less than 20 years away, and possibly even less than 10.

Re:How DALL-E 2 Works by spunker540 on Tuesday April 19, 2022 @10:12PM (#31091991)
Can you elaborate on why it's a "dirty word"? I see a ton of potential with generative/procedural game elements, esp given all the recent AI breakthroughs. But I am more of a former gamer than current gamer and am surprised to hear it's a dirty word.
Re:How DALL-E 2 Works by simulate-me on Tuesday April 19, 2022 @11:03PM (#31092351)
"Procedural generation" usually means content generated by a human-crafted procedure. Given that a human made the algorithm by hand, its scope is limited and easily becomes repetitive.
Re:How DALL-E 2 Works by ackfoobar on Wednesday April 20, 2022 @12:24PM (#31099329)
In the future it will be "machine dreamed-up" instead of "procedural generated".
Re:How DALL-E 2 Works by mupuff1234 on Tuesday April 19, 2022 @02:32PM (#31087006)
I doubt it will beat a curated experience any time soon, but I do see a future where it could assist in creating that curated experience.
Re:How DALL-E 2 Works by kromem on Tuesday April 19, 2022 @06:57PM (#31090478)
For the format, AI dungeon already does.

When I played with it, I started a quest as a wizard looking for a book.

I was able to cast a tracking spell that led me to a giant library.

I could have it read the titles of the books on a shelf in front of me.

I could pick up any book and open to a random page and have it tell me what was in it.

One was about a little half-elf that had a magic flute that broke.

I cast a summoning spell to summon the half-elf and fix its flute, after which it happily played a song opening a door to another dimension filled with musical instruments.

Give me that level of emergent gameplay in a VR open world, and then just take my money and all my free time, as I'm never leaving.

We're simply very, very early on in what's arguably going to be the most transformative tech since the Internet. People predicted back then that the slow network which only offered basic things like email wasn't going to significantly disrupt things like retail.

They were only right in that it didn't remain slow and ended up doing a lot more than email.

This stuff is getting better way faster than any tech I've seen, and I used to consult for CEOs at Fortune 500s and sit on advisory boards on the topic of emerging tech.

I wouldn't be so quick to bet against it. We really haven't even started to see what these models can do in application.

Re:How DALL-E 2 Works by SleekEagle on Tuesday April 19, 2022 @03:23PM (#31087673)
Yes! So many exciting possibilities in so many industries. Hopefully it won't displace artists though, we'll have to find a way to manage the efficiency of AI with the curation of artists!
Re:How DALL-E 2 Works by simulate-me on Tuesday April 19, 2022 @11:03PM (#31092359)
It will definitely displace artists.
Re:How DALL-E 2 Works by theptip on Wednesday April 20, 2022 @01:41AM (#31093264)
On the other hand, it will empower and enrich people that are especially good at creating prompts that generate good content. Who knows if more jobs will be created than destroyed.
Re:How DALL-E 2 Works by smaudet on Tuesday April 19, 2022 @02:48PM (#31087247)
> I feel so happy and excited just thinking about the possibilities these techs are going to bring.

Like what?

I should preface by saying I think art is great, I know a lot of artists who struggle to make a living, and it is somewhat heartbreaking to think of all the poor art students who I guess we should pay for their educations and will never have careers now?

Re:How DALL-E 2 Works by password54321 on Tuesday April 19, 2022 @03:17PM (#31087588)
If you wanted one original character and you wanted shots of that character from multiple angles with a consistent look, Dalle 2 would already fail.
Re:How DALL-E 2 Works by smaudet on Tuesday April 19, 2022 @03:31PM (#31087798)
True, but artists also sell artwork - my question could be reframed as, if Dalle 2 can produce a Rembrandt, is a Rembrandt worth anything, even emotionally?
Re:How DALL-E 2 Works by SleekEagle on Tuesday April 19, 2022 @03:40PM (#31087943)
I think it's worth pointing out that DALL-E 2 mimics the style of famous artists. The artists had to come up with the original style in the first place!

There are highly competent artists that can create highly convincing copies (fabrications? forgeries?) of famous paintings. Are these paintings worth anything? No, because people find value in the specific contribution to the field of art that the particular painting represents.

I think we should look at DALL-E 2 like a highly competent artist that can produce convincing forgeries and even mimic the style of famous artists, but cannot replace the artists themselves.

Re:How DALL-E 2 Works by gwern on Tuesday April 19, 2022 @10:34PM (#31092140)
> I think we should look at DALL-E 2 like a highly competent artist that can produce convincing forgeries and even mimic the style of famous artists, but cannot replace the artists themselves.

We don't know that. DALL-E must encode its knowledge about art styles somewhere in a way which permits applying them to almost arbitrary contents, similar to style transfer. So, what do you get when you 'just interpolate' between artists in the high-dimensional space defined by a multi-billion parameter model? It is vanishingly unlikely that that point in the style latent space will correspond to the output of any artist who has ever lived. What if you manipulate the encoding to push it far away from the latent points of a large set of real artists? And so on. We don't know what that looks like or if the new styles would not be considered 'original' by critics unaware of the machine origin.

Re:How DALL-E 2 Works by smaudet on Tuesday April 19, 2022 @09:49PM (#31091837)
I don't know that the metaphor works out in your favor here... if you were to catch an art theif you might send them to prison. If you have automated the process of producing art theives, that seems like a problem you have caused. You HAVE replaced the talented artists, because you didn't need to consult the original artists.

How does this benefit society? Even in the case the artist themselves uses the generator, is the artist better off for no longer needing to create art? It's not like there is an economic advantage, and so there isn't as much incentive to create even original art anymore, someone can just immediately mimic it.

People mimicked art in past, but at least for the artist there was the value of honing their own skill, and remixing or enhancing it, maybe tools like this have the potential to destroy creativity itself.

Re:How DALL-E 2 Works by simonw on Tuesday April 19, 2022 @03:20PM (#31087626)
But a variant of Dall-E that output a textured 3D character model would work fantastically well.
Re:How DALL-E 2 Works by astrange on Tuesday April 19, 2022 @04:23PM (#31088520)
Only if you're sure it didn't memorize a copyrighted input, and only until everyone gets bored with its style or you want your assets to look the same in a predictable way.
Re:How DALL-E 2 Works by exolymph on Tuesday April 19, 2022 @03:01PM (#31087384)
We will still need people with taste to drive the machines and curate output.

Also, like, this is how the world works. To cite a hackneyed example, people who worked with horses had to figure something out when new tech displaced them. So will graphic designers, illustrators, et al, if indeed AI is a more competitive option for their services.

Re:How DALL-E 2 Works by visarga on Tuesday April 19, 2022 @03:53PM (#31088106)
Not just graphic designers. In NLP, what used to take years of data labelling, architecture design and model training now is being done zero-shot by GPT-3.

Simple automations can be driven by GPT-3 as well. It needs a representation of the screen and it will automate the task described in natural language.

Re:How DALL-E 2 Works by elhesuu on Tuesday April 19, 2022 @04:18PM (#31088442)
AI generated images are not art. They might use the same medium visual arts do, but they lack a meaningful vision of the world.

Of course defining art is a subject in itself, but I think that being afraid of AI replacing artists is comparable to thinking photography would when it was invented.

Re:How DALL-E 2 Works by splatzone on Saturday April 30, 2022 @08:44AM (#31215624)
This is a good point - all of the DALL-E images are interpretations of human prompts.

Human insight and imagination will always be needed to create meaningful, useful prompts

Re:How DALL-E 2 Works by cercatrova on Tuesday April 19, 2022 @04:31PM (#31088646)
So we should halt progress just so people can keep their jobs? I hate this argument whenever AI or automation is brought up, it's probably one of the worst ways to deal with it.
Re:How DALL-E 2 Works by nightski on Tuesday April 19, 2022 @04:46PM (#31088863)
As long as it is progress. What usually happens though is we get a watered down version of what we had before, but since it is cheaper and far more profitable the big companies exploit it to maximum effect. So in reality we lose a lot.

I'm hopeful but skeptical at the same time.

Re:How DALL-E 2 Works by smaudet on Tuesday April 19, 2022 @09:41PM (#31091796)
No thought is put into the effects of technology. You can have progress without trampling all over people and their livelihoods, but we don't often see any effort to do this.

Why are we focusing on image generation as the target for AI automation? It's not like there is a shortage of artists, expect perhaps amongst programmer bros. Why are there no efforts to automate away positions such as executive offices? Are CEOs so much difficult to replace than artisans?

"I invented a method to kill people, what are supposed to halt progress because more people die now? I hate it when people bring up that I'm a serial murderer".

There are things I would be doing with AI and things I would not. Being happy about making a even just a particular type of art redundant, well it if it doesn't benefit anyone then why would you care?

Besides, we have banned certain types of research before, precisely because we decided they weren't ethical. Your argument for "progress" is a poor one.

Re:How DALL-E 2 Works by cercatrova on Tuesday April 19, 2022 @10:00PM (#31091910)
> No thought is put into the effects of technology. You can have progress without trampling all over people and their livelihoods, but we don't often see any effort to do this.

Sure it is, and sure we do. There are ethics in AI boards for a reason at the major AI research companies, as well as many other technology-producing companies.

> Why are we focusing on image generation as the target for AI automation?

Who is "we?" Individual researchers focus on what they want because they like that topic of research. There is no committee out there who figures out, "what industry can we put people out of jobs this week?" No one wakes up thinking, "oh boy, time to put artists out of work."

> Why are there no efforts to automate away positions such as executive offices?

There are. See abstract thinking AI research.

> Are CEOs so much difficult to replace than artisans?

Yes? Abstract reasoning, allocation of abstract resources like engineers (not widgets or manufacturing) is not an easy task to create an AI for, if a CEO is automated then that means we've reached artificial general intelligence. In contrast, like you see with DALLE and others in this link, art is much easier to automate. This doesn't even get to the notion of artists being in a surplus, they choose to do art as their livelihood. Now, you could ask whether it's fair and whether we need a UBI or something like that, but that's a different question entirely.

> "I invented a method to kill people, what are supposed to halt progress because more people die now? I hate it when people bring up that I'm a serial murderer".

Funny you say that because the military has invented many things that are now used in civilian life [0]. Even the smartphone you use is in part due to their innovations. This is not even to bring up nuclear weapons, which while horrific, have effectively been used as MAD, not to mention a highly efficient energy source via nuclear energy.

> There are things I would be doing with AI and things I would not. Being happy about making a even just a particular type of art redundant, well it if it doesn't benefit anyone then why would you care?

You don't speak for everyone. Why wouldn't automating image or video generation be beneficial to "anyone?" I could imagine at least several use cases off the top of my head, such as a unique streaming service for every individual. Artists themselves can also be influenced by such media, it's not like they stopped after photography was invented. Art just changed.

> Besides, we have banned certain types of research before, precisely because we decided they weren't ethical. Your argument for "progress" is a poor one.

Perhaps we shouldn't be banning research just because of some subjective morality. You've shown no argument for why "progress" is a poor incentive, merely that you personally don't know or care enough about it.

And one more thing, art isn't done as a livelihood, it's done because the artist has a deep appreciation for the works they want to create. That some do it as a money-making endeavor is immaterial to this fact.

[0] https://en.wikipedia.org/wiki/List_of_military_inventions