MPI-INF Logo
MPI-INF/SWS Research Reports 1991-2021

1. Author,Editor - 1. by Individual

MPI-I-2005-4-004

Joint motion and reflectance capture for creating relightable 3D videos

Theobalt, Christian and Ahmed, Naveed and De Aguiar, Edilson and Ziegler, Gernot and Lensch, Hendrik and Magnor, Marcus A. and Seidel, Hans-Peter

March 2005, 18 pages.

.
Status: available - back from printing

Passive optical motion capture is able to provide authentically animated, photo-realistically and view-dependently textured models of real people. To import real-world characters into virtual environments, however, also surface reectance properties must be known. We describe a video-based modeling approach that captures human motion as well as reectance characteristics from a handful of synchronized video recordings. The presented method is able to recover spatially varying reectance properties of clothes by exploiting the time-varying orientation of each surface point with respect to camera and light direction. The resulting model description enables us to match animated subject appearance to different lighting conditions, as well as to interchange surface attributes among different people, e.g. for virtual dressing. Our contribution allows creating realistic 3D renditions of real-world people under arbitrary novel lighting conditions on standard graphics hardware.

  • MPI-I-2005-4-004.pdf
  • Attachement: MPI-I-2005-4-004.pdf (3603 KBytes)

URL to this document: https://domino.mpi-inf.mpg.de/internet/reports.nsf/NumberView/2005-4-004

Hide details for BibTeXBibTeX
@TECHREPORT{TheobaltAhmedDeAguiarZieglerLenschMagnorSeidel2005,
  AUTHOR = {Theobalt, Christian and Ahmed, Naveed and De Aguiar, Edilson and Ziegler, Gernot and Lensch, Hendrik and Magnor, Marcus A. and Seidel, Hans-Peter},
  TITLE = {Joint motion and reflectance capture for creating relightable 3D videos},
  TYPE = {Research Report},
  INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
  ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
  NUMBER = {MPI-I-2005-4-004},
  MONTH = {March},
  YEAR = {2005},
  ISSN = {0946-011X},
}