Shape By Scatter-Trace Photography

We present a new method for reconstructing the exterior surface of a complex transparent scene with inhomogeneous interior (e.g., multiple interfaces, reflective or painted interiors, etc). Our approach involves capturing images of the scene from one or more viewpoints while moving a proximal light source to a 2D or 3D set of positions. This gives a 2D (or 3D) dataset per pixel, called the scatter trace. The key idea of our approach is that even though light transport within a transparent scene’s interior can be exceedingly complex, the scatter trace of each pixel has a highlyconstrained geometry that (1) reveals the contribution of direct surface reflection, and (2) leads to a simple “scatter-trace stereo” algorithm for computing the local geometry of the exterior surface (depth and surface normals). We present 3D reconstruction results for a variety of scenes that exhibit complex light transport phenomena.
Nigel J. Morris (University of Toronto)
Kiriakos N. Kutulakos (University of Toronto)
Related Publications
Nigel J. Morris and Kiriakos N. Kutulakos, Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter Trace Photography. Proc. 11th Int. Conf. on Computer Vision, Rio de Janeiro, Brazil, 2007.   PDF (549KB)    IEEEXplore entry
Supplementary Material
Supplementary material submitted to ICCV 2007, including videos and reconstructed 3D models (14.5MB zip file)
This work was supported in part by the Natural Sciences and Engineering Research Council of Canada under the RGPIN program, by the U.S. National Science Foundation under Grant No. IIS-0413198, and by the Province of Ontario under the OGSST and PREA pro- grams.
Site last modified on Wednesday, September 25, 2019
Send questions or comments about this page to Kyros Kutulakos