Tentative schedule for COMP 451
Lec. | Date | Topic | Reading | Additional Info |
---|---|---|---|---|
Introduction to machine learning |
Lecture notes (Chap 1) Jamboard Mandatory reading: This paper. | |||
Part I: Decision Boundaries |
||||
Instance-based learning |
Lecture notes (Chap 2) Jamboard |
|||
Parametric Learning and Perceptrons (Part I) |
Lecture notes (Chap 3; Sec 3.1-3.2) Jamboard |
|||
Parametric Learning and Perceptrons (Part II) |
Lecture notes (Chap 3; Sec 3.3) Jamboard |
|||
Part II: Likelihood |
||||
Maximum Likelihood |
Lecture notes (Chap 4) Jamboard |
|||
Naive Bayes (Part I) |
Lecture notes (Chap 5; Sec 5.1-5.3) Jamboard |
|||
Naive Bayes (Part II) |
Lecture notes (Chap 5; Sec 5.3-5.5) Jamboard |
Theory Assignment 1 Released Practice Assignment 1 Practice Assignment 1 (with solutions) Assignment 1 [Theory Assignment 1] (due Feb 9th) |
||
Logistic Regression |
Lecture notes (Chapter 6) Jamboard |
|||
Part III: Optimization |
||||
Empirical Risk Minimization |
Lecture notes (Chapter 7) Jamboard |
|||
Gradient Descent and Convexity |
Lecture notes (Chapter 8) Jamboard |
Theory Assignment 1 Due | ||
Linear Regression |
Lecture notes (Chapter 9) Jamboard |
Assignment 2 [Practical Assignment 1] (due Feb 23rd) |
||
Generalization and Overfitting |
Lecture notes (Chapter 10) Jamboard |
|||
Regularization |
Lecture notes (Chapter 11) Jamboard |
|||
Part IV: Information |
||||
Information Theory |
Lecture notes (Chapter 12) Jamboard |
Assignment 2 / Practical Assignment 1 Due Theory Assignment 2 (Practice) Theory Assignment 2 (Practice with Solutions) Assignment 3 [Theory Assignment 2] (due March 11) |
||
Decision Trees |
Lecture notes (Chapter 13) Jamboard |
|||
Study Break |
||||
Study Break |
||||
Part V: Latent Variables |
||||
Clustering |
Lecture notes (Chapter 14) Jamboard |
|||
Mixture Models |
Lecture notes (Chapter 15) Jamboard |
Assignment 3 [Theory Assignment 2] Due Assignment 4 [Practical Assignment 2] (due March 23rd) |
||
Part VI: Representations |
||||
Feature Design |
Lecture notes (Chapter 16) Jamboard |
|||
PCA |
Lecture notes (Chapter 17) Jamboard |
|||
Boltzmann Machines |
Lecture notes (Chapter 18) Jamboard |
Practical Assignment 2 Due | ||
Part VII: Neural Networks |
||||
Feedforward Neural Networks |
Slides |
Theory Assignment 3 (Practice) Theory Assignment 3 (Practice with Solutions) Assignment 5 [Theory Assignment 3] (due April 6) |
||
Optimizing Neural Networks |
Slides |
|||
Convolutional Neural Networks |
Slides |
|||
Recurrent Neural Networks |
Slides |
Theory Assignment 3 Due | ||
Autoencoders |
Slides |
|||
Review |