Campus Event Calendar
Event Entry
New for: D2, D3
What and Who
PhD Application Talk: Hand shape recognition using a ToF camera - an application to sign language
Martin Simonovsky
PhD Application Talk
AG 1, AG 2, AG 3, AG 4, AG 5, SWS, RG1, MMCI
MPI Audience
English
Note: We use this to send email in the morning.
Date, Time and Location
Monday, 25 July 2011
11:15
90 Minutes
E1 4
024
Saarbrücken
Abstract
We investigate the benefit of utilizing depth information acquired by a time-of-flight (ToF) camera for hand shape recognition from unrestricted viewpoints. Specifically, we assess the hypothesis that classical 3D content descriptors might be inappropriate for ToF depth images due to the 2.5D nature and noisiness of the data and possible expensive computations in 3D space. Instead, we extend 2D descriptors to make use of the additional semantics of depth images. Our system is based on the appearance-based retrieval paradigm, using a synthetic 3D hand model to generate its database. The system is able to run at interactive frame rates. For increased robustness, no color, intensity, or time coherence information is used. A novel, domain-specific algorithm for segmenting the forearm from the upper body based on reprojecting the acquired geometry into the lateral view is introduced. Moreover, three kinds of descriptors exploiting depth data are proposed and the made design choices are experimentally supported. The whole system is then evaluated on an American sign language fingerspelling dataset.
Contact
IMPRS-CS
-1803
--email hidden
passcode not visible
logged in users only
Tags, Category, Keywords and additional notes
Please note: The talks will take place in random order!
Heike Przybyl, 07/21/2011 12:30
Heike Przybyl, 07/21/2011 12:23 -- Created document.
Heike Przybyl, 07/21/2011 12:23 -- Created document.