Detailed Syllabus


Current quarter's videos are available through Panopto.
Course notes are published here.

WeekDateLecture TopicsCourseworkSections
1 Sep 22 & 24 Introduction (slides) + Background (slides) HW 1 released (09/24) Probability and Linear Algebra
2 Sep 29 & Oct 1 Autoregressive Models
(Wed. slides, Fri. slides)
PyTorch
3 Oct 06 & Oct 08 VAEs
(Wed. slides, Fri. slides)
CNNs, RNNs, Transformers
4 Oct 13 & Oct 15 Normalizing Flows
(Wed. slides, Fri. slides)
HW 1 due, HW 2 released
5 Oct 20 & Oct 22 GANs
(Wed. slides, Fri. slides)
Project Proposal: Due Wednesday, October 20, 2021.
6 Oct 27 & Oct 29 Energy Based Models
(Wed. slides, Fri. slides)
HW 2 Due
7 Nov 3 & Nov 5 Score Based Models
(Wed. slides, Fri. slides)
Midterm: Day: Nov. 4 - Nov. 6, 2021 (48 hr period) - Time: Any 3.5 hour period - Location: Online
8 Nov 10 & Nov 12 Evaluation of Generative Models (Slides)
Special topic: Combining generative model variants (Slides)
Project Progress Report due (11/12), HW 3 released
9 Nov 17 & Nov 19 Applications – GAIL (Slides)
Special topic: Discreteness in latent variable models (Slides)
10 Nov 24 & Nov 26 Thanksgiving Break
11 Dec 01 Applications - Others (Slides) HW 3 Due (Nov. 30th)
Poster Presentation: Day: December 03, 2021 - Time: Session A: 11am - 1pm, Session B: 1:30pm - 3:30pm - Location: McCaw Hall (Alumni Center)
12 Dec 06 Finals Week
Final Project Reports: Due Tuesday, December 07, 2021

Additional Reading: Surveys and Tutorials


  1. Generative Modeling by Estimating Gradients of the Data Distribution Yang Song. Blog post on score-based generative models, May 2021.
  2. How to Train Your Energy-Based Models. Yang Song and Diederik P. Kingma. February 2021.
  3. Tutorial on Deep Generative Models. Aditya Grover and Stefano Ermon. International Joint Conference on Artificial Intelligence, July 2018.
  4. Tutorial on Generative Adversarial Networks. Computer Vision and Pattern Recognition, June 2018.
  5. Tutorial on Deep Generative Models. Shakir Mohamed and Danilo Rezende. Uncertainty in Artificial Intelligence, July 2017.
  6. Tutorial on Generative Adversarial Networks. Ian Goodfellow. Neural Information Processing Systems, December 2016.
  7. Learning deep generative models. Ruslan Salakhutdinov. Annual Review of Statistics and Its Application, April 2015.