While 3D photography has seen many advances in recent years, objects
made of refractive or highly reflective materials (glass, mirrors,
liquids, etc) remain beyond the reach of existing techniques. These
objects cause light to "bend" or "bounce" one or more times, making it
difficult to invert the image formation process. To reconstruct such
objects, we have developed a general technique called "Light-Path
Triangulation," whose goal is to reconstruct the piecewise-linear 3D
path(s) traced by light as it travels from known reference patterns
toward the image plane of one or more cameras. In this talk, I will
discuss the conditions under which such reconstructions are possible
and present algorithms and promising results on reconstructing scenes
containing glass, mirrors, and flowing liquids.