Motion from Structure (MfS): Searching for 3D Objects in Cluttered Point Trajectories

June 2016

Motion from Structure (MfS): Searching for 3D Objects in Cluttered Point Trajectories

Authors:

J. Vongkulbhisal, R. Cabral, F. De La Torre, and J. Paulo Costeira
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

Object detection has been a long standing problem in computer vision, and state-of-the-art approaches rely on the use of sophisticated features and/or classifiers. However, these learning-based approaches heavily depend on the quality and quantity of labeled data, and do not generalize well to extreme poses or textureless objects. In this work, we explore the use of 3D shape models to detect objects in videos in an unsupervised manner. We call this problem Motion from Structure (MfS): given a set of point trajectories and a 3D model of the object of interest, find a subset of trajectories that correspond to the 3D model and estimate its alignment (i.e., compute the motion matrix). MfS is related to Structure from Motion (SfM) and motion segmentation problems: unlike SfM, the structure of the object is known but the correspondence between the trajectories and the object is unknown, unlike motion segmentation, the MfS problem incorporates 3D structure, providing robustness to tracking mismatches and outliers. Experiments illustrate how our MfS algorithm outperforms alternative approaches in both synthetic data and real videos extracted from YouTube.
@conference{Vongkulbhisal-2016-120886,
author = {J. Vongkulbhisal And R. Cabral And F. De La Torre And J. Paulo Costeira},
title = {Motion from Structure (MfS): Searching for 3D Objects in Cluttered Point Trajectories},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2016},
month = {June},
pages = {5639 - 5647},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.