Stable Diffusion in Layman's Terms

In Layman’s terms. Stable Diffusion is an AI model that generates images from text input.

You give the model Prompts such as:

gingerbread house, diorama, in focus, white background, toast , crunch cereal

The AI model would generate images that match the prompt.

There are similar text-to-image generation services like DALLE and MidJourney. Why Stable Diffusion? The advantages of Stable Diffusion are;

· Open-source: Many enthusiasts have created free and powerful tools.

· Designed for low-power computers: It’s free or cheap to run.

Advanced GUI Option for Stable Diffusion

You can use a more advanced GUI (Graphical User Interface) if you outgrow the

free online Stable Diffusion model usage services (text2image generators) since their functionalities are pretty limited.

AUTOMATIC1111, is a powerful and popular GUI choice.

(See the Quick Start Guide for setting up AUTOMATIC1111 in the Google Colab cloud server.)

You can run AUTOMATIC1111on your PC as well if you have a decent NVIDIA GPU with at least 4GB VRAM.

Why use an advanced GUI? A whole array of tools are at your disposal?

· Advanced prompting techniques

· Regenerate a small part of an image with Inpainting

· Generate images based on an input image (Image-to-image)

· Edit an image by telling an instruction.

If you want to use Stable Diffusion You can pick the option that's the best for you.

If you are a Beginner:

No setup - use a free online generator

Basic usage of text-to-image generation

If you are an Intermediate or Advanced user:

1-click Google Colab notebook running AUTOMATIC1111 GUI

(You need a paid Google Colab account ~ $10/month).

The following models are available:

· Stable Diffusion v1.4, v1.5, v1.5 inpainting and v2.1, v2 depth

· F222

· DreamShaper

· Anything v3

· Inkpunk Diffusion

· Instruct pix2pix

· VAEs from Stability

· ControlNet (tutorial here)

· Deforum (tutorial here)

· Load custom models, embeddings, and LoRA from your Google Drive

If you are an Advanced user:

Install AUTOMATIC1111 locally on Windows PC or Mac.

You will need a decent NVIDIA GPU with at least 4GB VRAM, 6GB Preferred.

Last updated