Real-time collaboration for Jupyter Notebooks, Linux Terminals, LaTeX, VS Code, R IDE, and more,
all in one place. Commercial Alternative to JupyterHub.
Real-time collaboration for Jupyter Notebooks, Linux Terminals, LaTeX, VS Code, R IDE, and more,
all in one place. Commercial Alternative to JupyterHub.
Path: blob/main/diffusers/ddim_noise_comparative_analysis.ipynb
Views: 2932
DDIM Noise Comparative Analysis Pipeline
The P2 weighting (CVPR 2022) paper proposed an approach to answer the above question, which is their second contribution. The approach consists of the following steps:
The input is an image x0.
Perturb it to xt using a diffusion process q(xt|x0).
strength
is a value between 0.0 and 1.0, that controls the amount of noise that is added to the input image. Values that approach 1.0 allow for lots of variations but will also produce images that are not semantically consistent with the input.Reconstruct the image with the learned denoising process pθ(ˆx0|xt).
Compare x0 and ˆx0 among various t to show how each step contributes to the sample. The authors used openai/guided-diffusion model to denoise images in FFHQ dataset. This pipeline extends their second contribution by investigating DDIM on any input image. This script was contributed by Anh Nguyen and the notebook by Parag Ekbote.