Journal Article
@Article
Artikel in Fachzeitschrift


Show entries of:

this year (2019) | last year (2018) | two years ago (2017) | Notes URL

Action:

login to update

Options:








Author, Editor(s)

Author(s):

Valgaerts, Levi
Wu, Chenglei
Bruhn, Andrés
Seidel, Hans-Peter
Theobalt, Christian

dblp
dblp
dblp
dblp
dblp

Not MPG Author(s):

Bruhn, Andrés

BibTeX cite key*:

Valgaerts2012

Title

Title*:

Lightweight Binocular Facial Performance Capture under Uncontrolled Lighting

Journal

Journal Title*:

ACM Transactions on Graphics (Proc. of ACM SIGGRAPH Asia)

Journal's URL:


Download URL
for the article:

http://doi.acm.org/10.1145/2366145.2366206

Language:

English

Publisher

Publisher's
Name:

ACM

Publisher's URL:

http://www.acm.org/

Publisher's
Address:

New York, USA

ISSN:

0730-0301

Vol, No, pp, Date

Volume*:

31

Number:

6

Publishing Date:

November 2012

Pages*:

1-11

Number of
VG Pages:

11

Page Start:

1

Page End:

11

Sequence Number:


DOI:

10.1145/2366145.2366206

Note, Abstract, ©

Note:


(LaTeX) Abstract:

Recent progress in passive facial performance capture has shown impressively detailed results on highly articulated motion. However, most methods rely on complex multi-camera set-ups, controlled lighting or fiducial markers. This prevents them from being used in general environments, outdoor scenes, during live action on a film set, or by freelance animators and everyday users who want to capture their digital selves. In this paper, we therefore propose a lightweight passive facial performance capture approach that is able to reconstruct high-quality dynamic facial geometry from only a single pair of stereo cameras. Our method succeeds under uncontrolled and time-varying lighting, and also in outdoor scenes. Our approach builds upon and extends recent image-based scene flow computation, lighting estimation and shading-based refinement algorithms. It integrates them into a pipeline that is specifically tailored towards facial performance reconstruction from challenging binocular footage under uncontrolled lighting. In an experimental evaluation, the strong capabilities of our method become explicit: We achieve detailed and spatio-temporally coherent results for expressive facial motion in both indoor and outdoor scenes -- even from low quality input images recorded with a hand-held consumer stereo camera. We believe that our approach is the first to capture facial performances of such high quality from a single stereo rig and we demonstrate that it brings facial performance capture out of the studio, into the wild, and within the reach of everybody.

URL for the Abstract:


Categories,
Keywords:

Three- Dimensional Graphics and Realism, Digitization and Image Capture — Scanning, Scene Analysis

HyperLinks / References / URLs:

http://gvv.mpi-inf.mpg.de/projects/FaceCap/

Copyright Message:

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted
without fee provided that copies are not made or distributed for profit or direct commercial advantage
and that copies show this notice on the first page or initial screen of a display along with the full citation.
Copyrights for components of this work owned by others than ACM must be honored. Abstracting with
credit is permitted. To copy otherwise, to republish, to post on servers, to redistribute to lists, or to use any
component of this work in other works requires prior specific permission and/or a fee. Permissions may be
requested from Publications Dept., ACM, Inc., 2 Penn Plaza, Suite 701, New York, NY 10121-0701, fax +1
(212) 869-0481, or permissions@acm.org.
© 2012 ACM 0730-0301/2012/11-ART187 $15.00 DOI 10.1145/2366145.2366206
http://doi.acm.org/10.1145/2366145.2366206

Personal Comments:


Download
Access Level:

Internal

Correlation

MPG Unit:

Max-Planck-Institut für Informatik



MPG Subunit:

Computer Graphics Group

MPG Subsubunit:

Graphics; Vision & Video

Audience:

popular

Appearance:

MPII WWW Server, MPII FTP Server, MPG publications list, university publications list, working group publication list, Fachbeirat, VG Wort


BibTeX Entry:

@ARTICLE{Valgaerts2012,
AUTHOR = {Valgaerts, Levi and Wu, Chenglei and Bruhn, Andr{\'e}s and Seidel, Hans-Peter and Theobalt, Christian},
TITLE = {Lightweight Binocular Facial Performance Capture under Uncontrolled Lighting},
BOOKTITLE = {ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH Asia)},
JOURNAL = {ACM Transactions on Graphics (Proc. of ACM SIGGRAPH Asia)},
PUBLISHER = {ACM},
YEAR = {2012},
ORGANIZATION = {Association for Computing Machinery (ACM)},
NUMBER = {6},
VOLUME = {31},
PAGES = {1--11},
ADDRESS = {Singapore},
MONTH = {November},
ISBN = {0730-0301},
DOI = {10.1145/2366145.2366206},
}


Entry last modified by Oliver Klehm, 04/04/2013
Show details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)
Hide details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)

Editor(s)
Levi Valgaerts
Created
12/16/2012 05:16:23 PM
Revisions
4.
3.
2.
1.
0.
Editor(s)
Oliver Klehm
Anja Becker
Uwe Brahm
Oliver Klehm
Oliver Klehm
Edit Dates
04/04/2013 04:59:39 PM
04.04.2013 14:04:23
02/12/2013 05:14:15 PM
02/05/2013 07:32:45 PM
12/16/2012 05:16:33 PM