CSC2515 Fall 2008
 Introduction to Machine Learning

Lecture 10a
 Kernel density estimators
and nearest neighbors

Histograms as density models

Some good and bad properties of histograms as density estimators

Local density estimators

Kernel density estimators

The density modeled by a kernel density estimator

Nearest neighbor methods for density estimation

Nearest neighbor methods for classification and regression

The decision boundary implemented by 3NN

Regions defined by using various numbers of neighbors