CoCalc Logo Icon
StoreFeaturesDocsShareSupportNewsAboutSign UpSign In
huggingface

Real-time collaboration for Jupyter Notebooks, Linux Terminals, LaTeX, VS Code, R IDE, and more,
all in one place. Commercial Alternative to JupyterHub.

GitHub Repository: huggingface/notebooks
 Path: blob/main/diffusers/stable_diffusion_comparison.ipynb
Views: 2932
Kernel: Unknown Kernel

Stable Diffusion Comparisons

This Community Pipeline enables the comparison between the 4 checkpoints that exist for Stable Diffusion. They can be found through the following links:

  1. Stable Diffusion v1.1

  2. Stable Diffusion v1.2

  3. Stable Diffusion v1.3

  4. Stable Diffusion v1.4

As a result, you can look at a grid of all 4 generated images being shown together, that captures a difference the advancement of the training between the 4 checkpoints.

This script was contributed by Suvaditya Mukherjee and the notebook by Parag Ekbote.

pip install diffusers matplotlib torch
Requirement already satisfied: diffusers in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (0.31.0) Requirement already satisfied: matplotlib in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (3.8.2) Requirement already satisfied: torch in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (2.2.1+cu121) Requirement already satisfied: importlib-metadata in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (8.5.0) Requirement already satisfied: filelock in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (3.16.1) Requirement already satisfied: huggingface-hub>=0.23.2 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (0.26.3) Requirement already satisfied: numpy in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (1.26.4) Requirement already satisfied: regex!=2019.12.17 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (2024.11.6) Requirement already satisfied: requests in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (2.32.3) Requirement already satisfied: safetensors>=0.3.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (0.4.5) Requirement already satisfied: Pillow in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from diffusers) (11.0.0) Requirement already satisfied: contourpy>=1.0.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (1.3.0) Requirement already satisfied: cycler>=0.10 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (4.54.1) Requirement already satisfied: kiwisolver>=1.3.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (1.4.7) Requirement already satisfied: packaging>=20.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (24.1) Requirement already satisfied: pyparsing>=2.3.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (3.2.0) Requirement already satisfied: python-dateutil>=2.7 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from matplotlib) (2.9.0.post0) Requirement already satisfied: typing-extensions>=4.8.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (4.12.2) Requirement already satisfied: sympy in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (1.13.3) Requirement already satisfied: networkx in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (3.4.2) Requirement already satisfied: jinja2 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (3.1.4) Requirement already satisfied: fsspec in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (2024.9.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (8.9.2.26) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (2.19.3) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: triton==2.2.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from torch) (2.2.0) Requirement already satisfied: nvidia-nvjitlink-cu12 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch) (12.6.77) Requirement already satisfied: pyyaml>=5.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from huggingface-hub>=0.23.2->diffusers) (6.0.2) Requirement already satisfied: tqdm>=4.42.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from huggingface-hub>=0.23.2->diffusers) (4.66.6) Requirement already satisfied: six>=1.5 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib) (1.16.0) Requirement already satisfied: zipp>=3.20 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from importlib-metadata->diffusers) (3.21.0) Requirement already satisfied: MarkupSafe>=2.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from jinja2->torch) (3.0.2) Requirement already satisfied: charset-normalizer<4,>=2 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from requests->diffusers) (3.4.0) Requirement already satisfied: idna<4,>=2.5 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from requests->diffusers) (3.10) Requirement already satisfied: urllib3<3,>=1.21.1 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from requests->diffusers) (2.2.3) Requirement already satisfied: certifi>=2017.4.17 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from requests->diffusers) (2024.8.30) Requirement already satisfied: mpmath<1.4,>=1.1.0 in /system/conda/miniconda3/envs/cloudspace/lib/python3.10/site-packages (from sympy->torch) (1.3.0) Note: you may need to restart the kernel to use updated packages. 
from diffusers import DiffusionPipeline
import matplotlib.pyplot as plt

pipe = DiffusionPipeline.from_pretrained('CompVis/stable-diffusion-v1-4', custom_pipeline='suvadityamuk/StableDiffusionComparison')
pipe.enable_attention_slicing()
pipe = pipe.to('cuda')
prompt = "an astronaut riding a horse on mars"
output = pipe(prompt)

plt.subplots(2,2,1)
plt.imshow(output.images[0])
plt.title('Stable Diffusion v1.1')
plt.axis('off')
plt.subplots(2,2,2)
plt.imshow(output.images[1])
plt.title('Stable Diffusion v1.2')
plt.axis('off')
plt.subplots(2,2,3)
plt.imshow(output.images[2])
plt.title('Stable Diffusion v1.3')
plt.axis('off')
plt.subplots(2,2,4)
plt.imshow(output.images[3])
plt.title('Stable Diffusion v1.4')
plt.axis('off')

plt.show()
An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-1/snapshots/574555a657f0c8d6e970a02c7e095e9d4220dcbf/unet: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-1/snapshots/574555a657f0c8d6e970a02c7e095e9d4220dcbf/unet. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead. An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-1/snapshots/574555a657f0c8d6e970a02c7e095e9d4220dcbf/vae: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-1/snapshots/574555a657f0c8d6e970a02c7e095e9d4220dcbf/vae. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead.
An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-2/snapshots/f519eebf1372598b85ab317ec273a63ebeddd5eb/unet: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-2/snapshots/f519eebf1372598b85ab317ec273a63ebeddd5eb/unet. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead. An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-2/snapshots/f519eebf1372598b85ab317ec273a63ebeddd5eb/vae: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-2/snapshots/f519eebf1372598b85ab317ec273a63ebeddd5eb/vae. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead.
An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-3/snapshots/159f26fccae6e3ea26c797ad24c5e7033da5b1ee/unet: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-3/snapshots/159f26fccae6e3ea26c797ad24c5e7033da5b1ee/unet. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead. An error occurred while trying to fetch /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-3/snapshots/159f26fccae6e3ea26c797ad24c5e7033da5b1ee/vae: Error no file named diffusion_pytorch_model.safetensors found in directory /home/zeus/.cache/huggingface/hub/models--CompVis--stable-diffusion-v1-3/snapshots/159f26fccae6e3ea26c797ad24c5e7033da5b1ee/vae. Defaulting to unsafe serialization. Pass `allow_pickle=False` to raise an error instead.
--------------------------------------------------------------------------- ValueError Traceback (most recent call last) Cell In[2], line 6 4 pipe = DiffusionPipeline.from_pretrained('CompVis/stable-diffusion-v1-4', custom_pipeline='suvadityamuk/StableDiffusionComparison') 5 pipe.enable_attention_slicing() ----> 6 pipe = pipe.to('cuda') 7 prompt = "an astronaut riding a horse on mars" 8 output = pipe(prompt)
File /home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py:411, in DiffusionPipeline.to(self, *args, **kwargs) 407 return hasattr(module, "_hf_hook") and isinstance(module._hf_hook, accelerate.hooks.CpuOffload) 409 # .to("cuda") would raise an error if the pipeline is sequentially offloaded, so we raise our own to make it clearer 410 pipeline_is_sequentially_offloaded = any( --> 411 module_is_sequentially_offloaded(module) for _, module in self.components.items() 412 ) 413 if pipeline_is_sequentially_offloaded and device and torch.device(device).type == "cuda": 414 raise ValueError( 415 "It seems like you have activated sequential model offloading by calling `enable_sequential_cpu_offload`, but are now attempting to move the pipeline to GPU. This is not compatible with offloading. Please, move your pipeline `.to('cpu')` or consider removing the move altogether if you use sequential offloading." 416 )
File /home/zeus/miniconda3/envs/cloudspace/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py:1541, in DiffusionPipeline.components(self) 1536 components = { 1537 k: getattr(self, k) for k in self.config.keys() if not k.startswith("_") and k not in optional_parameters 1538 } 1540 if set(components.keys()) != expected_modules: -> 1541 raise ValueError( 1542 f"{self} has been incorrectly initialized or {self.__class__} is incorrectly implemented. Expected" 1543 f" {expected_modules} to be defined, but {components.keys()} are defined." 1544 ) 1546 return components
ValueError: StableDiffusionComparisonPipeline { "_class_name": "StableDiffusionComparisonPipeline", "_diffusers_version": "0.31.0", "_name_or_path": "CompVis/stable-diffusion-v1-4", "pipeline1": [ "stable_diffusion", "StableDiffusionPipeline" ], "pipeline2": [ "stable_diffusion", "StableDiffusionPipeline" ], "pipeline3": [ "stable_diffusion", "StableDiffusionPipeline" ], "pipeline4": [ "stable_diffusion", "StableDiffusionPipeline" ] } has been incorrectly initialized or <class 'diffusers_modules.local.suvadityamuk--StableDiffusionComparison.22da2dc01eca56b3a7e21e34dc5d62e7cd0127dd.pipeline.StableDiffusionComparisonPipeline'> is incorrectly implemented. Expected {'vae', 'safety_checker', 'text_encoder', 'unet', 'scheduler', 'feature_extractor', 'tokenizer'} to be defined, but dict_keys(['pipeline1', 'pipeline2', 'pipeline3', 'pipeline4']) are defined.