Structure from Recurrent Motion: From Rigidity to Recurrency

June 2018

Structure from Recurrent Motion: From Rigidity to Recurrency

Authors:

Xiu Li, Hongdong Li, Hanbyul Joo, Yebin Liu, and Yaser Sheikh
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

This paper proposes a new method for Non-Rigid Structure-from-Motion (NRSfM) from a long monocular video sequence observing a non-rigid object performing recurrent and possibly repetitive dynamic action. Departing from the traditional idea of using linear low-order or low-rank shape model for the task of NRSfM, our method exploits the property of shape recurrency (i.e., many deforming shapes tend to repeat themselves in time). We show that recurrency is in fact a generalized rigidity. Based on this, we reduce NRSfM problems to rigid ones provided that certain recurrency condition is satisfied. Given such a reduction, standard rigid-SfM techniques are directly applicable (without any change) to the reconstruction of non-rigid dynamic shapes. To implement this idea as a practical approach, this paper develops efficient algorithms for automatic recurrency detection, as well as camera view clustering via a rigidity-check. Experiments on both simulated sequences and real data demonstrate the effectiveness of the method. Since this paper offers a novel perspective on rethinking structure-from-motion, we hope it will inspire other new problems in the field.
@conference{Li-2018-122179,
author = {Xiu Li And Hongdong Li And Hanbyul Joo And Yebin Liu And Yaser Sheikh},
title = {Structure from Recurrent Motion: From Rigidity to Recurrency},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2018},
month = {June},
pages = {3032 - 3040},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.