A toy experiment
Generate 100,000 images that have 784 pixels
but only 6 degrees of freedom.
Choose 3 x coordinates and 3 y coordinates
Fit a spline
Render the spline using logistic ink so that it
looks like a simple MNIST digit.
Then use a deep autoencoder to try to recover
the 6 dimensional manifold from the pixels.