Geoffrey E. Hinton

Information for prospective students, postdocs and visitors:
I will not be taking any more students, postdocs or visitors.

Basic papers on deep learning

LeCun, Y., Bengio, Y. and Hinton, G. E. (2015)
Deep Learning
Nature, Vol. 521, pp 436-444. [pdf]

Hinton, G. E., Osindero, S. and Teh, Y. (2006)
A fast learning algorithm for deep belief nets.
Neural Computation, 18, pp 1527-1554. [pdf]
Movies of the neural network generating and recognizing digits

Hinton, G. E. and Salakhutdinov, R. R. (2006)
Reducing the dimensionality of data with neural networks.
Science, Vol. 313. no. 5786, pp. 504 - 507, 28 July 2006.
[ full paper ] [ supporting online material (pdf) ] [ Matlab code ]

Recent Papers

Hinton, G. E. (2022)
The Forward-Forward Algorithm: Some Preliminary Investigations
arXiv:2212.13345
[pdf of final version]
[ffcode.zip matlab code for the supervised version of FF with the first 10 pixels being the labels]
[load mnistdata.mat in matlab to create the data]
[README.txt explains what to do to run FF}
Sindy Loewe's translation to python code is available at https://github.com/loeweX/Forward-Forward

Chen, T., Zhang, R., & Hinton, G. (2022)
Analog bits: Generating discrete data using diffusion models with self-conditioning
arXiv preprint arXiv:2208.04202 [pdf]

Ren, M., Kornblith, S., Liao, R., & Hinton, G. (2022)
Scaling Forward Gradient With Local Losses
arXiv preprint arXiv:2210.03310 [pdf]

Chen, T., Saxena, S., Li, L., Lin, T. Y., Fleet, D. J., & Hinton, G. (2022)
A unified sequence interface for vision tasks
arXiv preprint arXiv:2206.07669 [pdf]

Chen, T., Li, L., Saxena, S., Hinton, G., & Fleet, D. J.(2022)
A generalist framework for panoptic segmentation of images and videos
arXiv preprint arXiv:2210.06366 [pdf]

Liao, R., Kornblith, S., Ren, M., Fleet, D. J., & Hinton, G. (2022)
Gaussian-Bernoulli RBMs Without Tears
arXiv preprint arXiv:2210.10318 [pdf]

Culp, L., Sabour, S., & Hinton, G. E. (2022)
Testing GLOM's ability to infer wholes from ambiguous parts
arXiv preprint arXiv: 2211.16564 [pdf]

Agarwal, R., Melnick, L., Frosst, N., Zhang, X., Lengerich, B., Caruana, R., & Hinton, G. E. (2021)
Neural additive models:Interpretable machine learning with neural nets
Advances in Neural Information Processing Systems, 34, 4699-4711. [pdf]

Bengio, Y., Lecun, Y., & Hinton, G. (2021)
Deep learning for AI
Communications of the ACM, 64(7), 58-65. [pdf]

2021 commencement address at IIT Mumbai    

Joseph Turian's map of 2500 English words produced by using t-SNE on the word feature vectors learned by Collobert & Weston, ICML 2008    

Doing analogies by using vector algebra on word embeddings (in 2008)    

My old favorite Gary Marcus quote    

GPT-4 corrects Gary Marcus    

My new favorite Gary Marcus quote
"It gloms on to different clusters of text. That is all."

A new concept of healing from the people who design unimprovised explosive devices