Learning Silhouette Features for Control of Human Motion

October 2005

Learning Silhouette Features for Control of Human Motion

Authors:

Liu Ren, Gregory Shakhnarovich, Jessica K. Hodgins, Hanspeter Pfister, and Paul Viola

Abstract:

We present a vision-based performance interface for controlling animated human characters. The system combines information about the user's motion contained in silhouettes from several viewpoints with domain knowledge contained in a motion capture database to interactively produce a high quality animation. Such an interactive system will be useful for authoring, teleconferencing, or as a control interface for a character in a game. In our system, the user performs in front of three video cameras; the resulting silhouettes are used to estimate his or her orientation and body configuration based on a set of discriminative local features. Those features are selected by a machine learning algorithm during a preprocessing step. Sequences of motions that approximate the user's actions are extracted from the motion database and scaled in time to match the speed of the user's motion. We use swing dancing, an example of complex human motion, to demonstrate the effectiveness of our approach and compare the results obtained with discriminative local features to those obtained with global features, Hu moments, and to ground truth measurement from a motion capture system.
@article{Ren-2005-9327,
author = {Liu Ren And Gregory Shakhnarovich And Jessica K. Hodgins And Hanspeter Pfister And Paul Viola},
title = {Learning Silhouette Features for Control of Human Motion},
journal = {Proceedings of ACM Transactions on Graphics (TOG)},
year = {2005},
month = {October},
volume = {24},
number = {4},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.