Campus Event Calendar

Event Entry

What and Who

Exploring and editing the appearance of outdoor scenes

Pierre-Yves Laffont
Brown University

Pierre-Yves Laffont is a postdoctoral researcher at Brown University, with James Hays.
His research focuses on the appearance of outdoor scenes, intrinsic image decomposition, and image-based rendering/relighting with geometric cues from multi-view reconstruction. He did his PhD at INRIA Sophia-Antipolis under the supervision of George Drettakis and Adrien Bousseau, and spent a few months at UC Berkeley and MIT CSAIL. He also studied at INSA Lyon (France) and at KAIST (South Korea), and loves traveling.
AG 2, AG 4, SWS, MMCI  
MPI Audience

Date, Time and Location

Wednesday, 9 October 2013
60 Minutes
E1 4


The appearance of outdoor scenes changes dramatically with lighting and weather conditions, time of day, and season. Specific conditions, such as the "golden hours" characterized by warm light, can be hard to capture because many scene properties are transient -- they change over time. Despite significant advances in image editing software, common image manipulation tasks such as lighting editing require significant expertise to achieve plausible results.

In this talk, we first explore the appearance of outdoor scenes with an approach based on crowdsourcing and machine learning. We relate visual changes to scene attributes, which are human-nameable concepts used for high-level description of scenes. We collect a dataset containing thousands of outdoor images, annotate them with transient attributes, and train classifiers to recognize these properties in new images. We develop new interfaces for browsing photo collections, based on these attributes.

We then focus on specifically extracting and manipulating the lighting in a photograph. Intrinsic image decomposition separates a photograph into independent layers: reflectance, which represents the color of the materials, and illumination, which encodes the effect of lighting at each pixel. We tackle this ill-posed problem by leveraging additional information provided by multiple photographs of the scene. The methods we describe enable advanced image manipulations such as lighting-aware editing, insertion of virtual objects, and image-based illumination transfer between photographs of a collection.


Christian Theobalt
--email hidden
passcode not visible
logged in users only

Christian Theobalt, 10/07/2013 13:29 -- Created document.