Max-Planck-Institut für Informatik
max planck institut
informatik
mpii logo Minerva of the Max Planck Society
 

MPI-INF or MPI-SWS or Local Campus Event Calendar

<< Previous Entry Next Entry >> New Event Entry Edit this Entry Login to DB (to update, delete)
What and Who
Title:Exploring and editing the appearance of outdoor scenes
Speaker:Pierre-Yves Laffont
coming from:Brown University
Speakers Bio:Pierre-Yves Laffont is a postdoctoral researcher at Brown University, with James Hays.

His research focuses on the appearance of outdoor scenes, intrinsic image decomposition, and image-based rendering/relighting with geometric cues from multi-view reconstruction. He did his PhD at INRIA Sophia-Antipolis under the supervision of George Drettakis and Adrien Bousseau, and spent a few months at UC Berkeley and MIT CSAIL. He also studied at INSA Lyon (France) and at KAIST (South Korea), and loves traveling.

Event Type:Talk
Visibility:D2, D4, SWS, MMCI
We use this to send out email in the morning.
Level:MPI Audience
Language:English
Date, Time and Location
Date:Wednesday, 9 October 2013
Time:14:00
Duration:60 Minutes
Location:Saarbr├╝cken
Building:E1 4
Room:019
Abstract
The appearance of outdoor scenes changes dramatically with lighting and weather conditions, time of day, and season. Specific conditions, such as the "golden hours" characterized by warm light, can be hard to capture because many scene properties are transient -- they change over time. Despite significant advances in image editing software, common image manipulation tasks such as lighting editing require significant expertise to achieve plausible results.

In this talk, we first explore the appearance of outdoor scenes with an approach based on crowdsourcing and machine learning. We relate visual changes to scene attributes, which are human-nameable concepts used for high-level description of scenes. We collect a dataset containing thousands of outdoor images, annotate them with transient attributes, and train classifiers to recognize these properties in new images. We develop new interfaces for browsing photo collections, based on these attributes.

We then focus on specifically extracting and manipulating the lighting in a photograph. Intrinsic image decomposition separates a photograph into independent layers: reflectance, which represents the color of the materials, and illumination, which encodes the effect of lighting at each pixel. We tackle this ill-posed problem by leveraging additional information provided by multiple photographs of the scene. The methods we describe enable advanced image manipulations such as lighting-aware editing, insertion of virtual objects, and image-based illumination transfer between photographs of a collection.
Contact
Name(s):Christian Theobalt
Video Broadcast
Video Broadcast:NoTo Location:
Tags, Category, Keywords and additional notes
Note:
Attachments, File(s):

Created:Christian Theobalt/AG4/MPII/DE, 10/07/2013 01:29 PM Last modified:Uwe Brahm/MPII/DE, 11/24/2016 04:13 PM
  • Christian Theobalt, 10/07/2013 01:29 PM -- Created document.