Super interesting post. Tyvm!
Which three sources would you recommend for someone fluent in ML to read up on to arrive at your conclusions presented here (or their own)?
From there [3,4] show improvements to DDPMs, [5] shows that diffusion models can be very general. [7,8] show diffusion models from the view of score matching.
[1] AutoEncoding Variational Bayes
[2] Denoising Diffusion Probabilistic Models
[3] Denoising Implicit Models
[4] Improved Denoising Diffusion Probabilistic Models
[5] Cold Diffusion
[6] Deep Unsupervised Learning using Nonequilibrium Thermodynamics
[7] Generative Modeling by Estimating Gradients of the Data Distribution
[8] Score-Based Generative Modeling through Stochastic Differential Equations
[9] Variational Diffusion Models