3D LayoutCRF for Multi-View Object Class Recognition and Segmentation

June 2007

3D LayoutCRF for Multi-View Object Class Recognition and Segmentation

Authors:

Derek Hoiem, Carsten Rother, and John Winn
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

We introduce an approach to accurately detect and segment partially occluded objects in various viewpoints and scales. Our main contribution is a novel framework for combining object-level descriptions (such as position, shape, and color) with pixel-level appearance, boundary, and occlusion reasoning. In training, we exploit a rough 3D object model to learn physically localized part appearances. To find and segment objects in an image, we generate proposals based on the appearance and layout of local parts. The proposals are then refined after incorporating object-level information, and overlapping objects compete for pixels to produce a final description and segmentation of objects in the scene. A further contribution is a novel instance penalty, which is handled very efficiently during inference. We experimentally validate our approach on the challenging PASCAL?6 car database.
@conference{Hoiem-2007-9759,
author = {Derek Hoiem And Carsten Rother And John Winn},
title = {3D LayoutCRF for Multi-View Object Class Recognition and Segmentation},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2007},
month = {June},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.