Proceedings Article, Paper
@InProceedings
Beitrag in Tagungsband, Workshop


Show entries of:

this year (2019) | last year (2018) | two years ago (2017) | Notes URL

Action:

login to update

Options:








Author, Editor

Author(s):

Bargmann, Robert
Blanz, Volker
Seidel, Hans-Peter

dblp
dblp
dblp

Not MPG Author(s):

Blanz, Volker

Editor(s):

Chen, Bing-Yu

dblp

Not MPII Editor(s):

Chen, Bing-Yu

BibTeX cite key*:

Bargmann2005

Title, Booktitle

Title*:

Learning-Based Facial Rearticulation Using Streams of 3D Scans


bargmann_pg06.pdf (3351.09 KB)

Booktitle*:

The 14th Pacific Conference on Computer Graphics and Applications

Event, URLs

URL of the conference:

http://graphics.im.ntu.edu.tw/pg2006/

URL for downloading the paper:


Event Address*:

Taipei, Taiwan

Language:

English

Event Date*
(no longer used):


Organization:


Event Start Date:

11 October 2006

Event End Date:

13 October 2006

Publisher

Name*:

National Taiwan University

URL:


Address*:

Taipei, Taiwan

Type:


Vol, No, Year, pp.

Series:


Volume:


Number:


Month:

October

Pages:

232-241

Year*:

2006

VG Wort Pages:


ISBN/ISSN:


Sequence Number:


DOI:




Note, Abstract, ©


(LaTeX) Abstract:

In this paper, we present a new approach that generates synthetic mouth articulations from an audio file and that transfers them to different face meshes. It is based on learning articulations from a stream of 3D scans of a real person acquired by a structured light scanner at 40 three-dimensional frames per second. Correspondence between these scans over several speech sequences is established via optical flow. We propose a novel type of Principal Component Analysis that considers variances only in a sub-region of the face, while retaining the full dimensionality of the original vector space of sample scans. Audio is recorded at the same time, so the head scans can be synchronized with phoneme and viseme information for computing viseme clusters. Given a new audio sequence along with text data, we are able to quickly create in a fully automated fashion an animation synchronized with that new sentence by morphing between the visemes along a path in viseme-space. The methods described in the paper include an automated process for data analysis in streams of 3D scans, and a framework that connects the system to existing static face modeling technology for articulation transfer.

Keywords:

Computer Animation, Facial Animation, Rearticulation, Visemes, 3D Dynamic Scanner, Articulation Tranfer



Download
Access Level:

Public

Correlation

MPG Unit:

Max-Planck-Institut für Informatik



MPG Subunit:

Computer Graphics Group

Audience:

popular

Appearance:

MPII WWW Server, MPII FTP Server, MPG publications list, university publications list, working group publication list, Fachbeirat, VG Wort



BibTeX Entry:

@INPROCEEDINGS{Bargmann2005,
AUTHOR = {Bargmann, Robert and Blanz, Volker and Seidel, Hans-Peter},
EDITOR = {Chen, Bing-Yu},
TITLE = {Learning-Based Facial Rearticulation Using Streams of {3D} Scans},
BOOKTITLE = {The 14th Pacific Conference on Computer Graphics and Applications},
PUBLISHER = {National Taiwan University},
YEAR = {2006},
PAGES = {232--241},
ADDRESS = {Taipei, Taiwan},
MONTH = {October},
}


Entry last modified by Robert Bargmann, 03/05/2007
Show details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)
Hide details for Edit History (please click the blue arrow to see the details)Edit History (please click the blue arrow to see the details)

Editor(s)
Robert Bargmann
Created
12/04/2006 09:36:59 AM
Revisions
5.
4.
3.
2.
1.
Editor(s)
Robert Bargmann
Christine Kiesel
Robert Bargmann
Robert Bargmann
Robert Bargmann
Edit Dates
03/05/2007 02:48:22 PM
25.02.2007 15:41:48
01/04/2007 02:21:48 PM
01/04/2007 02:21:15 PM
01/04/2007 02:20:29 PM
Show details for Attachment SectionAttachment Section
Hide details for Attachment SectionAttachment Section

View attachments here:


File Attachment Icon
bargmann_pg06.pdf