Dropout

A technique for reducing over-fitting in large neural nets.

Papers

Improving neural networks by preventing co-adaptation of feature detectors [paper]
Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, Ilya Sutskever, Ruslan R. Salakhutdinov
arXiv preprint

Dropout: A simple way to prevent neural networks from overfitting [paper][bibtex]
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky, Ilya Sutskever, Ruslan R. Salakhutdinov
Journal of Machine Learning Research, June 2014.

Talk

Geoff's Talk

Model files

MNIST mnist.pbtxt
CIFAR-10 cifar10.pbtxt
CIFAR-100 cifar100.pbtxt
SVHN svhn.pbtxt
TIMIT timit.pbtxt

Code

Deepnet