News for hackers. Stuff that matters.

A comment on EditAnything: Segment Anything + ControlNet + BLIP2 + Stable Diffusion.

Re:EditAnything: Segment Anything + ControlNet + BLIP2 + Sta... by jack_riminton on Monday April 10, 2023 @04:26AM (#35510271)
I wonder if Segment Anything can work on things that aren't 'real looking' e.g. if I created a semi abstract piece in the style of Matisse on MidJourney, would it be able to segment the wiggly vase that doesn't look like a vase?
[ Parent | on HN ]
Re:EditAnything: Segment Anything + ControlNet + BLIP2 + Sta... by teruakohatu on Monday April 10, 2023 @04:31AM (#35510301)
It works fine on a Matisse-like image of a vase, such as this one by Kay Gallwey:

https://www.artsy.net/article/artsy-editorial-guide-painting...

[ Parent | on HN ]
Re:EditAnything: Segment Anything + ControlNet + BLIP2 + Sta... by runnerup on Monday April 10, 2023 @08:00AM (#35511323)
It works fine for me on very abstract stuff. Seems quite well generalized. Just wish they might release the CLIP encoder for it so you can prompt it with text prompts.
[ Parent | on HN ]
Re:EditAnything: Segment Anything + ControlNet + BLIP2 + Sta... by jack_riminton on Monday April 10, 2023 @08:41AM (#35511585)
Cool thanks. Yeah hopefully since Meta open-sourced the segmenter MidJourney is already working on it
[ Parent | on HN ]