Abstract: In this paper we propose a new method for precise face expression tracking in a video sequence which uses a hierarchical animation system built over a morphable polygonal 3D face model. Its low-level animation mechanism is based upon MPEG-4 specification which is implemented via local point-driven mesh deformations adaptive to the face geometry. The set of MPEG-4 animation parameters is in its turn controlled by a higher-level system based upon facial muscles structure. That allows us to perform precise tracking of complicated facial expressions as well as to produce face-to-face retargeting by transmitting the expression parameters to the different faces.