Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
Haoda Huang, Jinxiang Chai, Xin Tong, Hsiang-Tao Wu
In ACM Transactions on Graphics, 30(4), July 2011.
Abstract: This paper introduces a new approach for acquiring high-fidelity 3D facial performances with realistic dynamic wrinkles and fine-scale facial details. Our approach leverages state-of-the-art motion capture technology and advanced 3D scanning technology for facial performance acquisition. We start the process by recording 3D facial performances of an actor using a marker-based motion capture system and perform facial analysis on the captured data, thereby determining a minimal set of face scans required for accurate facial reconstruction. We introduce a two-step registration process to efficiently build dense consistent surface correspondences across all the face scans. We reconstruct high-fidelity 3D facial performances by combining motion capture data with the minimal set of face scans in the blendshape interpolation framework. We have evaluated the performance of our system on both real and synthetic data. Our results show that the system can capture facial performances that match both the spatial resolution of static face scans and the acquisition speed of motion capture systems.
Keyword(s): blendshape interpolation, face modeling, facial animation, facial data analysis, motion capture, nonrigid surface registration
@article{Huang:2011:LMC,
author = {Haoda Huang and Jinxiang Chai and Xin Tong and Hsiang-Tao Wu},
title = {Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition},
journal = {ACM Transactions on Graphics},
volume = {30},
number = {4},
pages = {74:1--74:10},
month = jul,
year = {2011},
}
Return to the search page.
graphbib: Powered by "bibsql" and "SQLite3."