zsikelianos

Thanks for your kinds words and feedback. I love seeing all these links to your scribbles.

I'm an engineer at Replicate, which is a place to run ML models in the cloud. We built Scribble Diffusion to demonstrate how to use Replicate. It's open source: https://github.com/replicate/scribble-diffusion

This is all built on ControlNet, a brilliant technique by Lyumin Zhang for controlling the outputs of diffusion models like Stable Diffusion. https://github.com/lllyasviel/ControlNet

Here's another example of someone doing something cool with ControlNet: https://twitter.com/dannypostmaa/status/1630442372206133248 -- it lets you pose a stick figure and generate DreamBooth images that match the pose.

I see a few bits of feedback here about issues with the Scribble Diffusion UI, and I'm tracking them on the GitHub repo. If you want to help out, please feel free to open an issue or pull request.

If you already have your own images, you can use the Replicate model directly: https://replicate.com/jagilley/controlnet-scribble -- you can upload your image using the Replicate web UI or do it programmatically using the model's HTTP API.

Sorry about the trouble. The Firefox incompatibility is the result of a bug in the underlying npm package we're using to render the drawing tool and canvas.

The issue is being tracked here: https://github.com/replicate/scribble-diffusion/issues/17#is...

We may need to wait for a fix to that, or consider swapping out the package we use for scribbling on a canvas.