Video face replacement
Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson, Daniel Vlasic, Wojciech Matusik, Hanspeter Pfister
In ACM Transactions on Graphics, 30(6), December 2011.
Abstract: We present a method for replacing facial performances in video. Our approach accounts for differences in identity, visual appearance, speech, and timing between source and target videos. Unlike prior work, it does not require substantial manual operation or complex acquisition hardware, only single-camera video. We use a 3D multilinear model to track the facial performance in both videos. Using the corresponding 3D geometry, we warp the source to the target face and retime the source to match the target performance. We then compute an optimal seam through the video volume that maintains temporal consistency in the final composite. We showcase the use of our method on a variety of examples and present the result of a user study that suggests our results are difficult to distinguish from real video footage.
Keyword(s): face replacement, facial animation, video compositing
Article URL: http://dx.doi.org/10.1145/2070781.2024164
BibTeX format:
@article{Dale:2011:VFR,
  author = {Kevin Dale and Kalyan Sunkavalli and Micah K. Johnson and Daniel Vlasic and Wojciech Matusik and Hanspeter Pfister},
  title = {Video face replacement},
  journal = {ACM Transactions on Graphics},
  volume = {30},
  number = {6},
  pages = {130:1--130:10},
  month = dec,
  year = {2011},
}
Search for more articles by Kevin Dale.
Search for more articles by Kalyan Sunkavalli.
Search for more articles by Micah K. Johnson.
Search for more articles by Daniel Vlasic.
Search for more articles by Wojciech Matusik.
Search for more articles by Hanspeter Pfister.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."