Expression flow for 3D-aware face component transfer
Fei Yang, Jue Wang, Eli Shechtman, Lubomir Bourdev, Dimitri Metaxas
In ACM Transactions on Graphics, 30(4), July 2011.
Abstract: We address the problem of correcting an undesirable expression on a face photo by transferring local facial components, such as a smiling mouth, from another face photo of the same person which has the desired expression. Direct copying and blending using existing compositing tools results in semantically unnatural composites, since expression is a global effect and the local component in one expression is often incompatible with the shape and other components of the face in another expression. To solve this problem we present Expression Flow, a 2D flow field which can warp the target face globally in a natural way, so that the warped face is compatible with the new facial component to be copied over. To do this, starting with the two input face photos, we jointly construct a pair of 3D face shapes with the same identity but different expressions. The expression flow is computed by projecting the difference between the two 3D shapes back to 2D. It describes how to warp the target face photo to match the expression of the reference photo. User studies suggest that our system is able to generate face composites with much higher fidelity than existing methods.
Keyword(s): face modeling, facial component, facial expression, facial flow, image warping
Article URL: http://dx.doi.org/10.1145/2010324.1964955
BibTeX format:
@article{Yang:2011:EFF,
  author = {Fei Yang and Jue Wang and Eli Shechtman and Lubomir Bourdev and Dimitri Metaxas},
  title = {Expression flow for 3D-aware face component transfer},
  journal = {ACM Transactions on Graphics},
  volume = {30},
  number = {4},
  pages = {60:1--60:10},
  month = jul,
  year = {2011},
}
Search for more articles by Fei Yang.
Search for more articles by Jue Wang.
Search for more articles by Eli Shechtman.
Search for more articles by Lubomir Bourdev.
Search for more articles by Dimitri Metaxas.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."