We need to keep the efficiency of using a gradient method
for adjusting the weights, but use it for modeling the
structure of the sensory input.
Adjust the weights to maximize the probability that a
generative model would have produced the sensory
input. This is the only place to get 10^5 bits per second.
Learn p(image) not p(label | image)
What kind of generative model could the brain be using?