Diffusion model - mathematics

Diffusion model : mathematics

Info
  1. VAE 很像。 03:29
  2. 26:06 Pasted image 20230412114611.png
  3. 简化 add noise 过程。 48:24
  4. 计算一个 lower bound。54:29 Pasted image 20230412124407.png
  5. Words is discrete, noise should be added to Word embedding. Or adding other noise not Gaussion distribution, such as [MASK]. 01:34:53
  6. Diffusion model is taking advantage of the autoregressive method and applys it to non-autoregressive model. 01:43:08