Rapid photorealistic blendshapes from commodity RGB-D sensors
Dan Casas, Oleg Alexander, Andrew W. Feng, Graham Fyffe, Ryosuke Ichikari, Paul Debevec, Rhuizhe Wang, Evan Suma, Ari Shapiro
Proceedings of the 19th Symposium on Interactive 3D Graphics and Games, 2015, pp. 134--134.
Abstract: Creating and animating a realistic 3D human face has been an important task in computer graphics. The capability of capturing the 3D face of a human subject and reanimate it quickly will find many applications in games, training simulations, and interactive 3D graphics. In this paper, we propose a system to capture photorealistic 3D faces and generate the blendshape models automatically using only a single commodity RGB-D sensor. Our method can rapidly generate a set of expressive facial poses from a single Microsoft Kinect and requires no artistic expertise on the part of the capture subject. The system takes only a matter of seconds to capture and produce a 3D facial pose and only requires 4 minutes of processing time to transform it into a blendshape model. Our main contributions include an end-to-end pipeline for capturing and generating face blendshape models automatically, and a registration method that solves dense correspondences between two face scans by utilizing facial landmark detection and optical flow. We demonstrate the effectiveness of the proposed method by capturing 3D facial models of different human subjects and puppeteering their models in an animation system with real-time facial performance retargeting.
Article URL: http://doi.acm.org/10.1145/2699276.2721398
BibTeX format:
@inproceedings{10.1145-2699276.2721398,
  author = {Dan Casas and Oleg Alexander and Andrew W. Feng and Graham Fyffe and Ryosuke Ichikari and Paul Debevec and Rhuizhe Wang and Evan Suma and Ari Shapiro},
  title = {Rapid photorealistic blendshapes from commodity RGB-D sensors},
  booktitle = {Proceedings of the 19th Symposium on Interactive 3D Graphics and Games},
  pages = {134--134},
  year = {2015},
}
Search for more articles by Dan Casas.
Search for more articles by Oleg Alexander.
Search for more articles by Andrew W. Feng.
Search for more articles by Graham Fyffe.
Search for more articles by Ryosuke Ichikari.
Search for more articles by Paul Debevec.
Search for more articles by Rhuizhe Wang.
Search for more articles by Evan Suma.
Search for more articles by Ari Shapiro.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."