Robust parameterized component analysis: Theory and applications to 2D facial appearance models

July 2003

Robust parameterized component analysis: Theory and applications to 2D facial appearance models

Authors:

F. De La Torre and M. J. Black

Abstract:

Principal component analysis (PCA) has been successfully applied to construct linear models of shape, graylevel, and motion in images. In particular, PCA has been widely used to model the variation in the appearance of people's faces. We extend previous work on facial modeling for tracking faces in video sequences as they undergo significant changes due to facial expressions. Here we consider person-specific facial appearance models (PSFAM), which use modular PCA to model complex intra-person appearance changes. Such models require aligned visual training data; in previous work, this has involved a time consuming and error-prone hand alignment and cropping process. Instead, the main contribution of this paper is to introduce parameterized component analysis to learn a subspace that is invariant to affine (or higher order) geometric transformations. The automatic learning of a PSFAM given a training image sequence is posed as a continuous optimization problem and is solved with a mixture of stochastic and deterministic techniques achieving sub-pixel accuracy. We illustrate the use of the 2D PSFAM model with preliminary experiments relevant to applications including video-conferencing and avatar animation.
@article{De-2003-120875,
author = {F. De La Torre And M. J. Black},
title = {Robust parameterized component analysis: Theory and applications to 2D facial appearance models},
journal = {Proceedings of Computer Vision and Image Understanding},
year = {2003},
month = {July},
volume = {91},
number = {1},
pages = {53 - 71},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.