Scribble Diffusion turns rough hand-drawn sketches into polished AI images from a simple text hint.
Scribble Diffusion is an open demo built on ControlNet-style sketch conditioning: draw a rough shape in the canvas, add a text description, and the model renders a finished image that follows your scribble’s structure. It is a playful, low-barrier way to guide image generation spatially instead of fighting prompts. The project is open source, so developers can study and extend it, and the hosted demo runs free in the browser.
Because the sketch acts as a spatial constraint, the workflow is iterative: draw, generate, adjust the scribble, regenerate. Designers find it excellent for storyboard thumbnails and ideation, where getting composition roughly right matters more than polish.
The technique behind it — conditioning diffusion models on spatial structure — is what makes sketch-guided generation work. For classrooms and workshops, Scribble Diffusion is a delightful introduction to how generative models can take direction.
Scribble Diffusion is free to use in the browser. Self-hosting costs only your own model compute.
Illustrators, designers, and hobbyists who can’t describe compositions well in words but can sketch them.
Yes, the hosted demo is free and the code is open source.
No hosted API; developers self-host the open-source project to embed it.
Standard text-to-image tools ignore spatial intent; Scribble Diffusion lets your sketch steer composition directly.
No, the hosted demo runs in your browser without local hardware requirements.
Yes, style guidance flows through the text prompt alongside the drawn structure.
Yes, generated images can be saved directly from the browser demo.
The open-source repository receives community contributions and improvements.
It excels at ideation and thumbnails; polished assets usually need further tooling.
Yes, the sketch directly controls composition while the prompt steers style.
It combines sketch conditioning with diffusion models and text prompts, letting drawings steer image composition directly.