CSC321: Neural Networks

Lecture 6: Learning in  recurrent networks

Backpropagation with weight constraints

Recurrent networks

An advantage of modeling sequential data

The equivalence between layered, feedforward nets and recurrent nets

Backpropagation through time

Teaching signals for recurrent networks

A good problem for a recurrent network

The algorithm for binary addition

A recurrent net for binary addition

The connectivity of the network

What the network learns