CSC321:Neural
Networks
Lecture 3: Learning in multi-layer networks
Preprocessing the input vectors
The connectivity of a perceptron
Why connectedness is hard to compute
Learning by perturbing weights
The idea behind backpropagation
Non-linear neurons with smooth derivatives
Sketch of the
backpropagation algorithm
on a single training case