Why the learning could be difficult
Consider a chain of units with visible units at the ends
If the training set is (1,0) and (0,1) we want the product
of all the weights to be negative.
So to know how to change w1 or w5 we must know w3.