3D-RelNet: Joint Object and Relational Network for 3D Prediction

October 2019

3D-RelNet: Joint Object and Relational Network for 3D Prediction

Conference Paper
Proceedings of (ICCV) International Conference on Computer Vision

Abstract:

We propose an approach to predict the 3D shape and pose for the objects present in a scene. Existing learning based methods that pursue this goal make independent predictions per object, and do not leverage the relationships amongst them. We argue that reasoning about these relationships is crucial, and present an approach to incorporate these in a 3D prediction framework. In addition to independent per-object predictions, we predict pairwise relations in the form of relative 3D pose, and demonstrate that these can be easily incorporated to improve object level estimates. We report performance across different datasets (SUNCG, NYUv2), and show that our approach significantly improves over independent prediction approaches while also outperforming alternate implicit reasoning methods.
@conference{Kulkarni-2019-121566,
author = {Nilesh Kulkarni And Ishan Misra And Shubham Tulsiani And Abhinav Gupta},
title = {3D-RelNet: Joint Object and Relational Network for 3D Prediction},
booktitle = {Proceedings of (ICCV) International Conference on Computer Vision},
year = {2019},
month = {October},
pages = {2212 - 2221},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.