Schedule for Machine Learning (COMP-652A)

Fall 2002


All the lecture notes will be linked to this web page, in PDF and postscript format. The reader for PDF files is available free from Adobe for UNIX, Apple Macintosh, and Windows. You can view both postscript and PDF files using ghostview. For printing convenience, I am including 2 slides per page. I am happy to release tex source files or postscript/PDF for the actual slides on request..

Tentative Schedule

Lec.
Date
Topic
Readings
Notes
1
Sep. 5
 Introduction  Mitchell, Chapter 1
 Slides: PS, PDF
 
2
Sep. 10
 Concept Learning and Version Spaces  Mitchell, Chapter 2
 Slides: PS, PDF
 
3
Sep. 12
 Bayesian Learning  Mitchell, Sections 6.1-6.4, 6.7-6.10
 Slides: PS, PDF
  Homework 1 Posted
PS, PDF
4
Sep. 17
 Basics of Information Theory. Decision Trees  Mitchell, Chapter 3
 Slides: PS, PDF
 
5
Sep. 19
 Decision Trees. Overfitting  Mitchell, Chapter 3, Section 6.6
 Slides: PS, PDF
  Homework 1 Due!
  Reading 1 Posted
6
Sep. 24
 Aritificial Neural Networks - I  Mitchell, Chapter 4
 Slides:
  Reading 1 Due!
7
Sep. 26
 Artificial Neural Networks - II  Mitchell, Chapter 4
 Slides: PS, PDF
 
8
Oct. 1
 Empirical Evaluation  Mitchell, Chapter 5
 
 Homework 2 Posted
PS, PDF
C4.5 web page UCI Repository
9
Oct. 3
 No lecture  
 
10
Oct. 8
 PAC-Learning  Mitchell, Sections 7.1-7.3
 Slides: PS, PDF
  Homework 2 Due!
Homework 3 Posted
PS, PDF
Book code and data
11
Oct. 10
 VC Dimension  Mitchell, Section 7.4
 Slides: PS, PDF
 
12
Oct. 15
 Instance-based Learning  Mitchell, Chapter 8
 Slides: PS, PDF
  Homework 3 Due!
13
Oct. 17
 Ensemble Classifiers: Overview, Bagging Overview by Dietterich,Empirical study by Opitz and Maclin
 Slides: PS, PDF
 
14
Oct. 22
No lecture  
  Homework 4 Posted
PS,PDF
15
Oct. 24
 Ensemble classifiers: Boosting Tutorial by Freund and Schapire
 Slides: PS, PDF
Applet by Ran El-Yaniv, Applet by Yoav Freund
 
16
Oct. 29
  First in-class examination    
17
Oct. 31
 Support Vector Machines  Burges tutorial
Scholkopf tutorial
 
18
Nov. 5
 Support Vector Machines - II  
 Slides: PS, PDF,
 
Homework 4 Due!
19
Nov. 7
 Reinforcement Learning - I  Barto & Sutton, Chapter 1, 3, 4
 Slides: PS, PDF
Homework 5 posted
PS,PDF
Reading 2 Posted
20
Nov. 12
 Reinforcement Learning - II   Barto & Sutton, Sections 5.1-5.3, 6.1-6.3
 Slides: Dynamic programming and Monte Carlo (PS,PDF), TD learning
  Reading 2 Due! 
21
Nov. 14
 Reinforcement learning - III   Barto & Sutton,Sections 6.4-6.5, 7.1-7.4, 8.1-8.3
 Slides: Monte Carlo vs. TD learning, Action values, Eligibility traces and function approximation (PS, PDF)
  Homework 5 Due! 
Homework 6 Posted
PS,PDF
22
Nov. 19
 Unsupervised Learning: K-means clustering Duda, Hart and Stork, Pattern classification, Chapter 10
 Slides: PS, PDF
 
23
Nov. 21
 Unsupervised Learning: Gaussian Mixture Models Mitchell, Section 6.12.
 
  Homework 6 Due!
24
Nov. 26
 No lecture  
 
Reading 4 Posted
25
Nov. 28
 Machine learning: Present and future
Class Evaluations
 
 
  Reading 4 Due!
26
Dec. 3
 Second in-class examination
   


Doina PRECUP
Last modified: Mon Dec 2 14:49:12 EST 2002