5 steps · about 40 min · 2014–2021

Generative image models

From adversarial training to score-based diffusion and latent synthesis, plus the representation learning and scene models that made controllable generation possible.

Fig. 02 / Reading route5 papers, in order
Reading path: Generative Adversarial Networks; Denoising Diffusion Probabilistic Models; High-Resolution Image Synthesis with Latent Diffusion Models; CLIP: Learning Transferable Visual Models From Natural Language Supervision; NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis0102030405
Start with Generative Adversarial Networks. Follow the numbered steps to NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.
  1. Generative Adversarial Networks 2014 · 7 min read · Beginner — An AI-generated review of the GAN framework, in which a generator and a discriminator compete to produce realistic data — one of the most influential ideas.
  2. Denoising Diffusion Probabilistic Models 2020 · 8 min read · Advanced — An AI-generated review of DDPM, the 2020 paper that turned diffusion models into the leading family of generative models for images.
  3. High-Resolution Image Synthesis with Latent Diffusion Models 2021 · 9 min read · Advanced — An AI-generated review of Latent Diffusion Models, the 2021 work that made text-to-image generation efficient and became the engine behind Stable Diffusion.
  4. CLIP: Learning Transferable Visual Models From Natural Language Supervision 2021 · 8 min read · Advanced — An AI-generated review of CLIP, the contrastive vision-language model that made zero-shot image classification and text-guided image understanding practical.
  5. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis 2020 · 8 min read · Advanced — An AI-generated review of NeRF, the 2020 method that represents a 3D scene as a neural field and renders photorealistic novel views from sparse input photos.

Every step as a full report

Prefer to jump around? Each step is a standalone report with its own citations, figures and FAQ.

Generative Adversarial Networks

Generative models · 7 min read · Beginner

An AI-generated review of the GAN framework, in which a generator and a discriminator compete to produce realistic data — one of the most influential ideas.

gangenerative-modelsadversarial-training Read

Denoising Diffusion Probabilistic Models

Generative models · 8 min read · Advanced

An AI-generated review of DDPM, the 2020 paper that turned diffusion models into the leading family of generative models for images.

diffusiongenerative-modelscomputer-vision Read