MPI-I-2006-5-003

In this report we present a video processing algorithm for texture replacement of moving garments. We use a color-coded pattern which encodes texture coordinates within a local neighborhood in order to robustly determine the geometric deformation of the fabric. A time-coherent texture interpolation is obtained by the use of 3D radial basis functions. Shading maps are determined with a technique operating in the image gradient domain. We use the recovered shading maps to realistically apply new textures to the color-coded garment in the video sequence. Our method enables editing and even completely exchanging fabric pattern designs of garments worn by actors as a video post-processing step.