Overcoming the limitations of  back-
propagation
• Keep the efficiency and simplicity of using a
gradient method for adjusting the weights, but use
it for modeling the structure of the sensory input.
– Adjust the weights to maximize the probability
that a generative model would have produced
the sensory input.
– Learn p(image)  not  p(label | image)
• If you want to do computer vision, first learn
computer graphics
• What kind of generative model should we learn?