News for hackers. Stuff that matters.
Re:Show HN: AI-Generated Illustrations of Plants by Yenrabbit on Tuesday August 24, 2021 @06:13AM (#28286869)
re: secret sauce, I tend to be in the 'sharing is caring' camp. The code for this was based on the popular notebook by @RiversHaveWings (VQGAN+CLIP) although I've edited it back and forth a few times. I usually run for a few hundred iterations (eg 250). EDIT: here's a Google Colab that replicates my plant generation: https://colab.research.google.com/drive/1b1UfblpdhPJ7f1WRjfC...
Re:Show HN: AI-Generated Illustrations of Plants by jcims on Tuesday August 24, 2021 @08:34AM (#28287966)
I'd like to humbly suggest that you give her CLIP guided diffusion model a try. It's blowing my mind.

https://colab.research.google.com/drive/12a_Wrfi2_gwwAuN3VvM...

Some recent output (prompts are summarized)

max max alien craft in the desert - https://imgur.com/a/1R5UZQb

worshippers gather at mad max alien craft in the desert - https://imgur.com/a/acdbLVu

vintage 70s alien spacecraft in the meadow - https://imgur.com/a/kwAVWG9

(note these are all upscaled with waifu2x)

My guess is that you've solved this already but I run it in a loop by replacing do_loop() at the bottom of the last frame with the following:

    import random
    prompt='crystalline alien spacecraft on a flower'
    modifiers=['',' macro photography', ' with hyperrealistic 35mm depth of field']
    original_prompt = prompt
    while True:
      for modifier in modifiers:
        prompt = original_prompt + modifier
        seed = random.randrange(1000)
        tqdm.write(f'Prompt {prompt}, Seed {seed}')
        do_run()
Re:Show HN: AI-Generated Illustrations of Plants by RiversHaveWings on Tuesday August 24, 2021 @08:46AM (#28288089)
Re:Show HN: AI-Generated Illustrations of Plants by jcims on Tuesday August 24, 2021 @08:55AM (#28288188)
Dang it! I knew this existed but I couldn't find it for some reason. Thank you!!! This has been a wonderful journey...my poor kids have been getting spammed with my latest incantations for the past week lol.

I keep trying to think of ways to make this more consumable for the less technically inclined, but GPUs are just not cheap. I was on a V100 for probably 36 hours through Colab via my $9 monthly subscription, that'd run $100 on AWS for the same amount of time on a p3. So then I'd need to figure out a tip jar or something to keep the gas tank full.

Re:Show HN: AI-Generated Illustrations of Plants by Yenrabbit on Tuesday August 24, 2021 @08:42AM (#28288051)
Had a play the other day - I love it! But it's quite slow, so for most of my experiments (which involve video and motion) I haven't yet found a way to incorporate it into my workflows without slowing things down considerably. Thanks for sharing though, the work she's doing is so great!
Re:Show HN: AI-Generated Illustrations of Plants by rapido-gato on Tuesday August 24, 2021 @01:42PM (#28292350)
dumb question, but what is that loop achieving?
Re:Show HN: AI-Generated Illustrations of Plants by jcims on Tuesday August 24, 2021 @02:12PM (#28292762)
Not dumb at all. This code is at the bottom of the notebook cell that actually generates the image. By default it's a one-shot deal, this allows me to continuously generate images with some perturbations in the input to build in some variety (seed value, some prompt 'modifiers' that tend to have a style transfer effect).
Re:Show HN: AI-Generated Illustrations of Plants by fumblebee on Wednesday August 25, 2021 @04:33AM (#28299225)
I'm curious, is there an advantage of doing style transfer implicitly via adding text over explicitly by providing a target image to copy the style from?
Re:Show HN: AI-Generated Illustrations of Plants by fumblebee on Tuesday August 24, 2021 @06:35AM (#28286986)
Thanks for taking the time to reply to my Qs; all useful insights and is much appreciated.

Mostly I'm excited about the direction and innovation velocity that AI art is going, but partly I'm anxious about what the eventual implications will be for human artists.

Re:Show HN: AI-Generated Illustrations of Plants by malka on Tuesday August 24, 2021 @10:28AM (#28289313)
Packaging is meh, but you can use my repo if you want to generate your images using the CLI, a discord bot, or an IRC bot with your own hardware: https://github.com/luc-leonard/clip_generators. It includes vqgan+clip and guided-diffusion models