Closed-Form Solutions for Low-Rank Non-Rigid Reconstruction

November 2015

Closed-Form Solutions for Low-Rank Non-Rigid Reconstruction

Authors:

J. Valmadre, S. Sridharan, S. Denman, C. Fookes, and S. Lucey

Abstract:

Recovering the motion of a non-rigid body from a set of monocular images permits the analysis of dynamic scenes in uncontrolled environments. However, the extension of factorisation algorithms for rigid structure from motion to the low-rank non- rigid case has proved challenging. This stems from the comparatively hard problem of finding a linear "corrective transform" which recovers the projection and structure matrices from an ambiguous factorisation. We elucidate that this greater difficulty is due to the need to find multiple solutions to a non-trivial problem, casting a number of previous approaches as alleviating this issue by either a) introducing constraints on the basis, making the problems non- identical, or b) incorporating heuristics to encourage a diverse set of solutions, making the problems inter-dependent. While it has previously been recognised that finding a single solution to this problem is sufficient to estimate cameras, we show that it is possible to bootstrap this partial solution to find the complete transform in closed-form. However, we acknowledge that our method minimises an algebraic error and is thus inherently sensitive to deviation from the low-rank model. We compare our closed-form solution for non-rigid structure with known cameras to the closed-form solution of Dai et al.~\cite{Dai2012}, which we find to produce only coplanar reconstructions. We therefore make the recommendation that 3D reconstruction error always be measured relative to a trivial reconstruction such as a planar one.
@conference{Valmadre-2015-121049,
author = {J. Valmadre And S. Sridharan And S. Denman And C. Fookes And S. Lucey},
title = {Closed-Form Solutions for Low-Rank Non-Rigid Reconstruction},
booktitle = {Proceedings of International Conference on Digital Image Computing: Techniques and Applications (DICTA '15)},
year = {2015},
month = {November},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.