Self-supervised backpropagation

recon- struction

• Autoencoders define the desired output to be the same as the input. – Trivial to achieve with direct connections • The identity is easy to compute! • It is useful if we can squeeze the information through some kind of bottleneck: – If we use a linear network this is very similar to Principal Components Analysis

200 logistic units

20 linear units

code

200 logistic units

data