Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera

July 2001

Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera

Authors:

Nobutaka Shimada, K. Kimura, and Y. Shirai

Abstract:

This paper proposes a system for estimating arbitrary 3D human hand postures in real-time. It can accept not only pre-determined hand signs but also arbitrary postures and it works in a monocular camera environment. The estimation is based on a 2D image retrieval. More than 16,000 possible hand appearances are first generated from a given 3D shape model by rotating model joints and stored in an appearance database. Every appearance is tagged with its own joint angles which are used when the appearance was generated. By retrieving the appearance in the database well-matching to the input image contour, the joint angles of the input shape can be rapidly obtained. The search area is reduced by using an adjacency map in the database. To prevent tracking failures, a fixed number of the well-matching appearances are saved at every frame. After the multiple neighborhoods of the saved appearances are merged, the unified neighborhood is searched for the estimate efficiently by beam search. The posture estimates result from experimental examples are shown.
@workshop{Shimada-2001-16823,
author = {Nobutaka Shimada And K. Kimura And Y. Shirai},
title = {Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera},
booktitle = {Proceedings of ICCV '01 Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems},
year = {2001},
month = {July},
pages = {23 - 30},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.