Analyzing 3D Objects in Cluttered Images

December 2012

Analyzing 3D Objects in Cluttered Images

Authors:

Mohsen Hejrati and Deva Ramanan
Conference Paper
Proceedings of (NeurIPS) Neural Information Processing Systems

Abstract:

We present an approach to detecting and analyzing the 3D configuration of objects in real-world images with heavy occlusion and clutter. We focus on the application of finding and analyzing cars. We do so with a two-stage model; the first stage reasons about 2D shape and appearance variation due to within-class variation (station wagons look different than sedans) and changes in viewpoint. Rather than using a view-based model, we describe a compositional representation that models a large number of effective views and shapes using a small number of local view-based templates. We use this model to propose candidate detections and 2D estimates of shape. These estimates are then refined by our second stage, using an explicit 3D model of shape and viewpoint. We use a morphable model to capture 3D within-class variation, and use a weak-perspective camera model to capture viewpoint. We learn all model parameters from 2D annotations. We demonstrate state-of-the-art accuracy for detection, viewpoint estimation, and 3D shape reconstruction on challenging images from the PASCAL VOC 2011 dataset.
@conference{Hejrati-2012-121202,
author = {Mohsen Hejrati And Deva Ramanan},
title = {Analyzing 3D Objects in Cluttered Images},
booktitle = {Proceedings of (NeurIPS) Neural Information Processing Systems},
year = {2012},
month = {December},
pages = {593 - 601},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.