Campus Event Calendar
Event Entry
What and Who
Exploring and editing the appearance of outdoor scenes
Pierre-Yves Laffont
Brown University
Talk
Pierre-Yves Laffont is a postdoctoral researcher at Brown University, with James Hays.
His research focuses on the appearance of outdoor scenes, intrinsic image decomposition, and image-based rendering/relighting with geometric cues from multi-view reconstruction. He did his PhD at INRIA Sophia-Antipolis under the supervision of George Drettakis and Adrien Bousseau, and spent a few months at UC Berkeley and MIT CSAIL. He also studied at INSA Lyon (France) and at KAIST (South Korea), and loves traveling.
AG 2, AG 4, SWS, MMCI
MPI Audience
English
Note: We use this to send email in the morning.
Date, Time and Location
Wednesday, 9 October 2013
14:00
60 Minutes
E1 4
019
Saarbrücken
Abstract
The appearance of outdoor scenes changes dramatically with lighting and weather conditions, time of day, and season. Specific conditions, such as the "golden hours" characterized by warm light, can be hard to capture because many scene properties are transient -- they change over time. Despite significant advances in image editing software, common image manipulation tasks such as lighting editing require significant expertise to achieve plausible results.
In this talk, we first explore the appearance of outdoor scenes with an approach based on crowdsourcing and machine learning. We relate visual changes to scene attributes, which are human-nameable concepts used for high-level description of scenes. We collect a dataset containing thousands of outdoor images, annotate them with transient attributes, and train classifiers to recognize these properties in new images. We develop new interfaces for browsing photo collections, based on these attributes.
We then focus on specifically extracting and manipulating the lighting in a photograph. Intrinsic image decomposition separates a photograph into independent layers: reflectance, which represents the color of the materials, and illumination, which encodes the effect of lighting at each pixel. We tackle this ill-posed problem by leveraging additional information provided by multiple photographs of the scene. The methods we describe enable advanced image manipulations such as lighting-aware editing, insertion of virtual objects, and image-based illumination transfer between photographs of a collection.
In this talk, we first explore the appearance of outdoor scenes with an approach based on crowdsourcing and machine learning. We relate visual changes to scene attributes, which are human-nameable concepts used for high-level description of scenes. We collect a dataset containing thousands of outdoor images, annotate them with transient attributes, and train classifiers to recognize these properties in new images. We develop new interfaces for browsing photo collections, based on these attributes.
We then focus on specifically extracting and manipulating the lighting in a photograph. Intrinsic image decomposition separates a photograph into independent layers: reflectance, which represents the color of the materials, and illumination, which encodes the effect of lighting at each pixel. We tackle this ill-posed problem by leveraging additional information provided by multiple photographs of the scene. The methods we describe enable advanced image manipulations such as lighting-aware editing, insertion of virtual objects, and image-based illumination transfer between photographs of a collection.
Contact
Christian Theobalt
--email hidden
passcode not visible
logged in users only
Christian Theobalt, 10/07/2013 13:29 -- Created document.