Max-Planck-Institut für Informatik
max planck institut
mpii logo Minerva of the Max Planck Society


Gesture modeling and animation by imitation

Albrecht, Irene and Kipp, Michael and Neff, Michael and Seidel, Hans-Peter

MPI-I-2006-4-008. August 2006, 62 pages. | Status: available - back from printing | Next --> Entry | Previous <-- Entry

Abstract in LaTeX format:
Animated characters that move and gesticulate appropriately with spoken
text are useful in a wide range of applications. Unfortunately, they are
very difficult to generate, even more so when a unique, individual
movement style is required. We present a system that is capable of
producing full-body gesture animation for given input text in the style of
a particular performer. Our process starts with video of a performer whose
gesturing style we wish to animate. A tool-assisted annotation process is
first performed on the video, from which a statistical model of the
person.s particular gesturing style is built. Using this model and tagged
input text, our generation algorithm creates a gesture script appropriate
for the given text. As opposed to isolated singleton gestures, our gesture
script specifies a stream of continuous gestures coordinated with speech.
This script is passed to an animation system, which enhances the gesture
description with more detail and prepares a refined description of the
motion. An animation subengine can then generate either kinematic or
physically simulated motion based on this description. The system is
capable of creating animation that replicates a particular performance in
the video corpus, generating new animation for the spoken text that is
consistent with the given performer.s style and creating performances of a
given text sample in the style of different performers.
References to related material:

To download this research report, please select the type of document that fits best your needs.Attachement Size(s):
MPI-I-2006-4-008pdf.pdf4534 KBytes
Please note: If you don't have a viewer for PostScript on your platform, try to install GhostScript and GhostView
URL to this document:
Hide details for BibTeXBibTeX
  AUTHOR = {Albrecht, Irene and Kipp, Michael and Neff, Michael and Seidel, Hans-Peter},
  TITLE = {Gesture modeling and animation by imitation},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2006-4-008},
  MONTH = {August},
  YEAR = {2006},
  ISSN = {0946-011X},