Multi-view NRSfM: Affordable Setup for High-Fidelity 3D Reconstruction

May 2021

Multi-view NRSfM: Affordable Setup for High-Fidelity 3D Reconstruction

Authors:

Mosam Dabhi

Abstract:

Triangulating a point in 3D space should only require two corresponding camera projections. However in practice, expensive multi-view setups -- involving tens sometimes hundreds of cameras -- are required to obtain the high fidelity 3D reconstructions necessary for many modern applications. In this thesis, we argue that similar fidelity can be obtained using as little as two cameras by breaking the tenet of rigidity which is central to much of modern multi-view geometry. Our approach instead leverages recent advances in Non-Rigid Structure from Motion (NRSfM) using neural shape priors while also enforcing multi-view equivariance. We show how our method can achieve comparable fidelity to expensive multi-view rigs using only two physical camera views.

Notes:

@mastersthesis{Dabhi-2021-127444,
author = {Mosam Dabhi},
title = {Multi-view NRSfM: Affordable Setup for High-Fidelity 3D Reconstruction},
year = {2021},
month = {May},
school = {Carnegie Mellon University},
address = {Pittsburgh, PA},
number = {CMU-RI-TR-21-12},
keywords = {Multi-view 3D reconstruction, Non-rigid objects, Neural Shape Prior},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.