A system for automatic animation of piano performances
Yuanfeng Zhu, Ajay Sundar Ramakrishnan, Bernd Hamann, Michael Neff
In Computer Animation and Virtual Worlds, 24(5), 2013.
Abstract: Playing the piano requires one to precisely position one's hand in order to strike particular combinations of keys at specific moments in time. This paper presents the first system for automatically generating three-dimensional animations of piano performance, given an input midi music file. A graph theory-based motion planning method is used to decide which set of fingers should strike the piano keys for each chord. As the progression of the music is anticipated, the positions of unused fingers are calculated to make possible efficient fingering of future notes. Initial key poses of the hands, including those for complex piano techniques such as crossovers and arpeggio, are determined on the basis of the finger positions and piano theory. An optimization method is used to refine these poses, producing a natural and minimal energy pose sequence. Motion transitions between poses are generated using a combination of sampled piano playing motion and music features, allowing the system to support different playing styles. Our approach is validated through direct comparison with actual piano playing and simulation of a complete music piece requiring various playing skills. Extensions of our system are discussed.
Keyword(s): piano animation, fingering generation, optimization method
Article URL: http://dx.doi.org/10.1002/cav.1477
BibTeX format:
@article{Zhu:2013:ASF,
  author = {Yuanfeng Zhu and Ajay Sundar Ramakrishnan and Bernd Hamann and Michael Neff},
  title = {A system for automatic animation of piano performances},
  journal = {Computer Animation and Virtual Worlds},
  volume = {24},
  number = {5},
  pages = {445--457},
  year = {2013},
}
Search for more articles by Yuanfeng Zhu.
Search for more articles by Ajay Sundar Ramakrishnan.
Search for more articles by Bernd Hamann.
Search for more articles by Michael Neff.

Return to the search page.


graphbib: Powered by "bibsql" and "SQLite3."