CSC2515 Fall 2007
 Introduction to Machine Learning

Lecture 7b: Kernel density estimators and nearest neighbors

Histograms as density models

Some good and bad properties of histograms as density estimators

Local density estimators

Kernel density estimators

The density modeled by a kernel density estimator

Nearest neighbor methods

The decision boundary implemented by 3NN

Regions defined by using various numbers of neighbors