MPI-I-2005-4-004
Joint motion and reflectance capture for creating relightable 3D videos
Theobalt, Christian and Ahmed, Naveed and De Aguiar, Edilson and Ziegler, Gernot and Lensch, Hendrik and Magnor, Marcus A. and Seidel, Hans-Peter
March 2005, 18 pages.
.
Status: available - back from printing
Passive optical motion capture is able to provide authentically animated, photo-realistically and view-dependently
textured models of real people. To import real-world characters into virtual environments, however, also surface
reectance properties must be known. We describe a video-based modeling approach that captures human motion
as well as reectance characteristics from a handful of synchronized video recordings. The presented method is
able to recover spatially varying reectance properties of clothes by exploiting the time-varying orientation of
each surface point with respect to camera and light direction. The resulting model description enables us to match
animated subject appearance to different lighting conditions, as well as to interchange surface attributes among
different people, e.g. for virtual dressing. Our contribution allows creating realistic 3D renditions of real-world
people under arbitrary novel lighting conditions on standard graphics hardware.
-
- Attachement: MPI-I-2005-4-004.pdf (3603 KBytes)
URL to this document: https://domino.mpi-inf.mpg.de/internet/reports.nsf/NumberView/2005-4-004
BibTeX
@TECHREPORT{TheobaltAhmedDeAguiarZieglerLenschMagnorSeidel2005,
AUTHOR = {Theobalt, Christian and Ahmed, Naveed and De Aguiar, Edilson and Ziegler, Gernot and Lensch, Hendrik and Magnor, Marcus A. and Seidel, Hans-Peter},
TITLE = {Joint motion and reflectance capture for creating relightable 3D videos},
TYPE = {Research Report},
INSTITUTION = {Max-Planck-Institut f{\"u}r Informatik},
ADDRESS = {Stuhlsatzenhausweg 85, 66123 Saarbr{\"u}cken, Germany},
NUMBER = {MPI-I-2005-4-004},
MONTH = {March},
YEAR = {2005},
ISSN = {0946-011X},
}