Deleted Interpolation Using a Hierarchical Bayesian Grammar Network for Recognizing Human Activity

October 2005

Deleted Interpolation Using a Hierarchical Bayesian Grammar Network for Recognizing Human Activity

Authors:

Kris M. Kitani, Yoichi Sato, and Akihiro Sugimoto

Abstract:

From the viewpoint of an intelligent video surveillance system, the high-level recognition of human activity requires a priori hierarchical domain knowledge as well as a means of reasoning based on that knowledge. We approach the problem of human activity recognition based on the understanding that activities are hierarchical, temporally constrained and temporally overlapped. While stochastic grammars and graphical models have been widely used for the recognition of human activity, methods combining hierarchy and complex queries have been limited. We propose a new method of merging and implementing the advantages of both approaches to recognize activities in real-time. To address the hierarchical nature of human activity recognition, we implement a hierarchical Bayesian network (HBN) based on a stochastic context-free grammar (SCFG). The HBN is applied to digressive substrings of the current string of evidence via deleted interpolation (DI) to calculate the probability distribution of overlapped activities in the current string. Preliminary results from the analysis of activity sequences from a video surveillance camera show the validity of our approach.
@workshop{Kitani-2005-109834,
author = {Kris M. Kitani And Yoichi Sato And Akihiro Sugimoto},
title = {Deleted Interpolation Using a Hierarchical Bayesian Grammar Network for Recognizing Human Activity},
booktitle = {Proceedings of IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS '05)},
year = {2005},
month = {October},
pages = {239 - 246},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.