MPI-INF/SWS Research Reports 1991-2021

2. Number - only D4


Fast Tracking of Hand and Finger Articulations Using a Single Depth Camera

Sridhar, Srinad and Oulasvirta, Antti and Theobalt, Christian

October 2014, 14 pages.

Status: available - back from printing

Using hand gestures as input in human--computer interaction is of ever-increasing interest. Markerless tracking of hands and fingers is a promising enabler, but adoption has been hampered because of tracking problems, complex and dense capture setups, high computing requirements, equipment costs, and poor latency. In this paper, we present a method that addresses these issues. Our method tracks rapid and complex articulations of the hand using a single depth camera. It is fast (50~fps without GPU support) and supports varying close-range camera-to-scene arrangements, such as in desktop or egocentric settings, where the camera can even move. We frame pose estimation as an optimization problem in depth using a new objective function based on a collection of Gaussian functions, focusing particularly on robust tracking of finger articulations. We demonstrate the benefits of the method in several interaction applications ranging from manipulating objects in a 3D blocks world to egocentric interaction on the go. We also present extensive evaluation of our method on publicly available datasets which shows that our method achieves competitive accuracy.

URL to this document:

Hide details for BibTeXBibTeX
  AUTHOR = {Sridhar, Srinad and Oulasvirta, Antti and Theobalt, Christian},
  TITLE = {Fast Tracking of Hand and Finger Articulations Using a Single Depth Camera},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2014-4-002},
  MONTH = {October},
  YEAR = {2014},
  ISSN = {0946-011X},