CSC 2541
Topics in Machine Learning:
Natural Scene Statistics
Winter 2005

Schedule of Presentations

Class	Topic	Paper Title	Author(s)	Presenters
Jan. 7	Natural image statistics	Statistics of natural images and models The statistics of natural images	Huang, Mumford Ruderman	Zemel (notes: ps; pdf)
Jan. 14	Non-Gaussian marginals	Natural image statistics and efficient coding "Independent components" of natural scenes... ICA tutorial (bkgd reading)	Olshausen & Field Bell & Sejnowski Hyvarinen	Zemel (notes: ps; pdf)
Jan. 21	Markov Random Fields & texture analysis	Learning low-level vision Minimax principle...	Freeman, Pasztor, Carmichael Zhu, Mumford	Cheung
Jan. 28	Beyond edges	Natural signal statistics Multi-layer sparse coding	Schwartz, Simoncelli Hoyer, Hyvarinen	Silva (notes;demo) Thanga
Feb. 4	Higher-order structure	Learning higher-order... GSMs	Karklin, Lewicki Wainwright, Simoncelli	Ross Braziunas
Feb. 11	Intrinsic images	Deriving intrinsic images... Recovering intrinsic images...	Weiss Tappen et al	Zemel/Marlin (notes;demo) A Mnih
Feb. 18	Reading Week
Feb. 25	Classification & segmentation	Natural image categories Learning to detect image boundaries (short;long)	Torralba & Oliva Martin et al	Hyndman Ray
Mar. 7	Graphics applications	Flash/no-flash Inpainting Epitomes	Petschnigg et al Levin et al Jojic et al	Bondarenko Shai Shai
Mar. 11	Forgery detection	Art authentication Exposing digital forgeries	Popescu/Farid Lyu et al	Coleman Azarmgin
Mar. 18	Learning visual features	Products of experts Products of topographic features ( short; long)	Hinton Osindero et al	Osindero
Mar. 25	Good Friday
Apr. 1	Sequences	Spatiotemporal sparse coding Activity bubbles and natural image sequences	Olshausen Hyvarinen et al	He V Mnih
Apr. 8	Son et lumiere	Chromatic structure of natural images Coding natural sounds	Wachtler et al Lewicki	Brubaker Azarmgin

OTHER TOPICS/PAPERS

Learning intrinsic images (low-level vision):

Deriving intrinsic images from image sequences. Weiss Y. ICCV 2001. (paper) (matlab code)

Recovering intrinsic images from a single image M. Tappen, W. Freeman and E. Adelson, NIPS 15. (paper)

Gaussian scale mixtures:

M. J. Wainwright and E. P. Simoncelli. Scale Mixtures of Gaussians and the Statistics of Natural Images. Conference on Neural Information Processing Systems (NIPS). Denver, CO. Nov 29-Dec 2, 1999; pages 855--861. (paper)

Image denoising using scale mixtures of Gaussians in the wavelet domain J Portilla, V Strela, M Wainwright and E P Simoncelli. IEEE Trans Image Processing, 12(11): 1338-1351, Nov 2003. (paper) (website)

Higher order structure:

Natural signal statistics and sensory gain control. O Schwartz and E P Simoncelli. Nature Neuroscience, 4(8):819-825, August 2001.

Karklin, Y. and Lewicki, M.S. (2003) "Learning higher-order structures in natural images." Network: Computation in Neural Systems, 14: 483-499. paper

Assignment of Multiplicative Mixtures in Natural Images. Odelia Schwartz, Terrence J. Sejnowski, and Peter Dayan. Advances in Neural Information Processing Systems 17, 2005. To appear. paper

P. O. Hoyer and A. Hyvarinen. A Multi-Layer Sparse Coding Network Learns Contour Coding from Natural Images. Vision Research. 42(12):1593-1605, 2002.

Sounds:

Lewicki, M.S. (2002) "Efficient coding of natural sounds." Nature Neurosci. 5(4):356-363 paper ; news and views

Sequences:

Yasuyuki Matsushita, Stephen Lin, Sing Bing Kang, and Heung-Yeung Shum, Estimating Intrinsic Images from Image Sequences with Biased Illumination, ECCV2004. paper

Categorization:

Statistics of natural image categories A. Torralba and A. Oliva 2003 Network: Comput. Neural Syst. 14 391-412. paper

Edge Detection:

Statistical Edge Detection: Learning and Evaluating Edge Cues. S. M. Konishi, A.L. Yuille, J.M. Coughlan and Song Chun Zhu. Pattern Analysis and Machine Intelligence. January. 2003. paper

Color:

T. Wachtler, T.-W. Lee and T.J. Sejnowski. The Chromatic Structure of Natural Scenes, Journal of the Optical Society of America, A , Vol 18 (1), 65-77, Jan. 2001. paper

Image compression:

Image compression via joint statistical characterization in the wavelet domain. R W Buccigrossi and E P Simoncelli. IEEE Trans Image Processing, 8(12):1688-1701, Dec 1999. (paper) (website)

Texture synthesis:

A parametric texture model based on joint statistics of complex wavelet coefficients. J Portilla and E P Simoncelli. Int'l Journal of Computer Vision, 40(1):49-71, October, 2000. (paper) (website)

Transparency:

Separating Reflections from a Single Image Using Local Features. A. Levin, A. Zomet and Y. Weiss IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2004, Washington DC (paper)

Forgery detection:

Exposing Digital Forgeries by Detecting Traces of Re-sampling A.C. Popescu and H. Farid IEEE Transactions on Signal Processing, 2005 (in press) (paper)

A Digital Technique for Art Authentication S. Lyu, D. Rockmore and H. Farid Proceedings of the National Academy of Sciences, 101(49):17006-17010, 2004 (paper)

Graphics applications:

Reinhard, E., Shirley, P., Ashikhmin, M., Troscianko, T. "Second order image statistics in computer graphics" ACM Symposium on Applied Perception in Computer Graphics and Visualization (2004) (paper)

Flash Photography Enhancement via Intrinsic Relighting Elmar Eisemann and Fredo Durand. (website)

Ganesh Ramanarayanan, Kavita Bala, and Bruce Walter. Feature-Based Textures. Proceedings of Eurographics Symposium on Rendering (EGSR) 2004. (paper)

Tumblin, J., Choudhury, P., "Bixels: Picture Samples with Sharp Embedded Boundaries" Proc. of the Eurographics Symposium on Rendering, Henrik Wann-Jensen and Alexander Keller eds., pp. 186-196, 2004. (paper) (source code)

Learning How to Inpaint from Global Image Statistics. Levin A., Zomet A. and Weiss Y. ICCV 2003 (paper)

Colorization using Optimization. A. Levin D. Lischinski and Y. Weiss ACM Transactions on Graphics, Aug 2004. pdf additional results (website)

Image processing applications:

How Realistic is Photorealistic? S. Lyu and H. Farid IEEE Transactions on Signal Processing, 2005 (in press) (paper)

Blind Removal of Lens Distortions H. Farid and A.C. Popescu Journal of the Optical Society of America, 18(9):2072-2078, 2001 (paper)

How to write a conference paper:

How to Get Your SIGGRAPH Paper Rejected, Jim Kajiya, SIGGRAPH 1993 Papers Chair, (paper)