MPI-INF Logo
Campus Event Calendar

Event Entry

What and Who

"The taking into account of role-shift in sign language generation : insights from Embodied Conversational Agents"

Alexis Heloir
VALORIA (Université de
Talk
AG 1, AG 2, AG 3, AG 4, AG 5, SWS, RG1, RG2  
AG Audience
English

Date, Time and Location

Thursday, 14 February 2008
14:15
60 Minutes
D3 1 - DFKI
-2.17, ground level
Saarbrücken

Abstract


We present in this talk our investigation dedicated toward the design and
animation of realistic signing agents. The highlight is focused on the taking
into account of sign languages' specificity : iconic intend. We highlight the
fact that our problematics stays at the crossroad between three domains :
linguistics of signed languages, expressive virtual agents and computer
animation.

By focusing on the particular aspects of sign language, we highlight the
importance of iconicity in the generation of meaningful utterances in signed
language. Iconicity is a linguistic theory which describe the processes
aiming at picturing the perceptual world thanks to the iconic ressemblance of
the forms to what they represent. This process, known as "iconic intend" is
described according to "highly iconic structures" : "transfers of form &
size", "transfers of situation" and "transfers of person". Among those
structures, we focus on "transfers of person" (role shifts) and show how the
qualitative aspects of gesture may convey meaningful information about the
embodied character depicted in the discourse (internal state, cultural
traits, etc.).
We then show how existing work dedicated to embodied conversational agents may
define a set of "traits" giving insights on how an embodied agent should
gesture during role shift.

We then present a qualitative and quantitative analysis performed over
captured captured gesture sequences of french sign language gestures. Each
sequence differs only in the expressive quality of the gestures.
We show that style has an influence on surfacing gestures both over temporal,
spatial, structural aspects but as well on the repartition of gesture phases
along the discourse.

We finally present the software tools we developed in order to validate our
hypothesis. We first introduce SMR, a generic library written in C++ and
dedicated to the analysis and synthesis of skeletal animation. We then
briefly present the protypes GUI we designed in order to validate our motion
generation algorithms.

Contact

Michael Kipp
+49 681 302-5256
--email hidden
passcode not visible
logged in users only

Alexandra Klasen, 02/12/2008 16:19 -- Created document.