Analysis by Synthesis: 3D Object Recognition by Object Reconstruction

June 2014

Analysis by Synthesis: 3D Object Recognition by Object Reconstruction

Authors:

Mohsen Hejrati and Deva Ramanan
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

We introduce a new approach for recognizing and reconstructing 3D objects in images. Our approach is based on an analysis by synthesis strategy. A forward synthesis model constructs possible geometric interpretations of the world, and then selects the interpretation that best agrees with the measured visual evidence. The forward model synthesizes visual templates defined on invariant (HOG) features. These visual templates are discriminatively trained to be accurate for inverse estimation. We introduce an efficient "brute-force" approach to inference that searches through a large number of candidate reconstructions, returning the optimal one. One benefit of such an approach is that recognition is inherently (re)constructive. We show state of the art performance for detection and reconstruction on two challenging 3D object recognition datasets of cars and cuboids.
@conference{Hejrati-2014-121192,
author = {Mohsen Hejrati And Deva Ramanan},
title = {Analysis by Synthesis: 3D Object Recognition by Object Reconstruction},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2014},
month = {June},
pages = {2449 - 2456},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.