CSC2515 Fall 2008
Introduction to Machine
Learning
Lecture 10a
Kernel density estimators
and nearest neighbors
Histograms as density models
Some good and bad properties
of histograms as density estimators
Local density estimators
Kernel density estimators
The density modeled by a
kernel density estimator
Nearest neighbor methods for
density estimation
Nearest neighbor methods for
classification and regression
The decision boundary
implemented by 3NN
Regions defined by using
various numbers of neighbors