Representing Pairwise Spatial and Temporal Relations for Action Recognition

September 2010

Representing Pairwise Spatial and Temporal Relations for Action Recognition

Conference Paper
Proceedings of (ECCV) European Conference on Computer Vision

Abstract:

The popular bag-of-words paradigm for action recognition tasks is based on building histograms of quantized features, typically at the cost of discarding all information about relationships between them. However, although the beneficial nature of including these relationships seems obvious, in practice finding good representations for feature relationships in video is difficult. We propose a simple and computationally efficient method for expressing pairwise relationships between quantized features that combines the power of discriminative representations with key aspects of Naive Bayes. We demonstrate how our technique can augment both appearance- and motion-based features, and that it significantly improves performance on both types of features.
@conference{Matikainen-2010-10525,
author = {Pyry K. Matikainen And Martial Hebert And Rahul Sukthankar},
title = {Representing Pairwise Spatial and Temporal Relations for Action Recognition},
booktitle = {Proceedings of (ECCV) European Conference on Computer Vision},
year = {2010},
month = {September},
editor = {K. Daniilidis, P. Maragos, N. Paragios},
pages = {508 - 521},
keywords = {action recognition, spatial relationships},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.