A picture of PCA with N=2 and M=1
The red point is represented by the
green point. Our “reconstruction” of
the red point has an error equal to the
squared distance between red and
green points.
First principal component:
Direction of greatest variance