|
Training a deep autoencoder or a classifier on MNIST digits
Code provided by Ruslan Salakhutdinov and Geoff Hinton
Permission is granted for anyone to copy, use, modify, or distribute this
program and accompanying programs and documents for any purpose, provided
this copyright notice is retained and prominently displayed, along with
a note saying that the original programs are available from our
web page.
The programs and documents are distributed without any warranty, express or
implied. As the programs were written for research purposes only, they have
not been tested to the degree that would be advisable in any important
application. All use of these programs is entirely at the user's own risk.
How to make it work:
- Create a separate directory and download all these files into the same directory
- Download from http://yann.lecun.com/exdb/mnist
the following 4 files:
- train-images-idx3-ubyte.gz
- train-labels-idx1-ubyte.gz
- t10k-images-idx3-ubyte.gz
- t10k-labels-idx1-ubyte.gz
- Unzip these 4 files by executing:
- gunzip train-images-idx3-ubyte.gz
- gunzip train-labels-idx1-ubyte.gz
- gunzip t10k-images-idx3-ubyte.gz
- gunzip t10k-labels-idx1-ubyte.gz
If unzipping with WinZip, make sure the file names have not been
changed by Winzip.
- Download Conjugate Gradient code
minimize.m
- Download Autoencoder_Code.tar which contains 13 files
OR
download
each of the following 13 files separately for training an autoencoder and a classification model:
- mnistdeepauto.m Main file for training deep autoencoder
- mnistclassify.m Main file for training classification model
- converter.m Converts raw MNIST digits into matlab format
- rbm.m Training RBM with binary hidden and binary visible units
- rbmhidlinear.m Training RBM with Gaussian
hidden and binary visible units
- backprop.m Backpropagation for fine-tuning an autoencoder
- backpropclassify.m Backpropagation for classification using "encoder" network
- CG_MNIST.m Conjugate Gradient optimization for fine-tuning an autoencoder
- CG_CLASSIFY_INIT.m Conjugate Gradient optimization for classification (training top-layer weights
while holding low-level weights fixed)
- CG_CLASSIFY.m Conjugate Gradient optimization for classification (training all weights)
- makebatches.m Creates minibatches for RBM training
- mnistdisp.m Displays progress during fine-tuning stage
- README.txt
- For training a deep autoencoder run mnistdeepauto.m in matlab.
- For training a classification model run mnistclassify.m in matlab.
- Make sure you have enough space to
store the entire MNIST dataset on your disk. You can also set various parameters in the code, such as
maximum number of epochs, learning rates, network architecture, etc.
|