News for hackers. Stuff that matters.
Re:Show HN: Shortbread, create AI comics in minutes by alex_c on Friday October 06, 2023 @03:21PM (#37795047)
Very cool! I was briefly toying with something similar just last week.

Main challenge I see is character consistency. I really like the way you set up the prompts, but even so:

Outfit - a simple black sleeveless gi with white pants, a black belt tied around his waist

In two consecutive panels, the output swaps the colors (first panel gets it right, second panel has white gi, black pants).

Curious how you'll tackle this challenge!

Re:Show HN: Shortbread, create AI comics in minutes by fengjiaopeng on Friday October 06, 2023 @03:51PM (#37795413)
Hi Alex, great catch -> We didn't solve consistency, but we saw that if you regenerate a few times, you usually get something that's visually similar. Right now AI artists all do loads of postprocessing - using AI, so later we might have a "smear" feature that inpaints the inconsistent part. Let me know if you have thoughts on this
Re:Show HN: Shortbread, create AI comics in minutes by mentos on Friday October 06, 2023 @05:44PM (#37796834)
Could eventually use GPT4vision to review the output of the art to see if all the panels are consistent?
Re:Show HN: Shortbread, create AI comics in minutes by nottheengineer on Friday October 06, 2023 @06:09PM (#37797016)
People can generate a few good samples of what they want a character to look like and then interrogate clip to get a more detailed prompt that makes it more consistent. It increases the prompt sizes a lot, but I don't think there's an easy way to solve this.

Maybe you could build a UI that semi-automates this process?