Discriminative Models of Multi-Class Object Layout

September 2009

Discriminative Models of Multi-Class Object Layout

Authors:

Chaitanya Desai, Deva Ramanan, and Charless Fowlkes
Conference Paper
Proceedings of (ICCV) International Conference on Computer Vision

Abstract:

Many state-of-the-art approaches for object recognition reduce the problem to a 0-1 classification task. Such reductions allow one to leverage sophisticated classifiers for learning. These models are typically trained independently for each class using positive and negative examples cropped from images. At test-time, various post-processing heuristics such as non-maxima suppression (NMS) are required to reconcile multiple detections within and between different classes for each image. Though crucial to good performance on benchmarks, this post-processing is usually defined heuristically. We introduce a unified model for multi-class object recognition that casts the problem as a structured prediction task. Rather than predicting a binary label for each image window independently, our model simultaneously predicts a structured labeling of the entire image. Our model learns statistics that capture the spatial arrangements of various object classes in real images, both in terms of which arrangements to suppress through NMS and which arrangements to favor through spatial co-occurrence statistics. We formulate parameter estimation in our model as a max-margin learning problem. Given training images with ground-truth object locations, we show how to formulate learning as a convex optimization problem. We employ a cutting plane algorithm similar to efficiently learn a model from thousands of training images. We show state-of-the-art results on the PASCAL VOC benchmark that indicate the benefits of learning a global model encapsulating the spatial layout of multiple object classes.
Published in: 2009 IEEE 12th
@conference{Desai-2009-121222,
author = {Chaitanya Desai And Deva Ramanan And Charless Fowlkes},
title = {Discriminative Models of Multi-Class Object Layout},
booktitle = {Proceedings of (ICCV) International Conference on Computer Vision},
year = {2009},
month = {September},
pages = {229 - 236},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.