3D Shape and Indirect Appearance by Structured Light Transport

June 2014

3D Shape and Indirect Appearance by Structured Light Transport

Authors:

Matthew O'Toole, John Mather, and Kiriakos N. Kutulakos
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

We consider the problem of deliberately manipulating the direct and indirect light flowing through a time-varying, fully-general scene in order to simplify its visual analysis. Our approach rests on a crucial link between stereo geometry and light transport: while direct light always obeys the epipolar geometry of a projector-camera pair, indirect light overwhelmingly does not. We show that it is possible to turn this observation into an imaging method that analyzes light transport in real time in the optical domain, prior to acquisition. This yields three key abilities that we demonstrate in an experimental camera prototype: (1) producing a live indirect-only video stream for any scene, regardless of geometric or photometric complexity, (2) capturing images that make existing structured-light shape recovery algorithms robust to indirect transport, and (3) turning them into one-shot methods for dynamic 3D shape capture.

Notes:

Best Paper Honourable Mention
@conference{O'Toole-2014-127025,
author = {Matthew O'Toole And John Mather And Kiriakos N. Kutulakos},
title = {3D Shape and Indirect Appearance by Structured Light Transport},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2014},
month = {June},
pages = {3246 - 3253},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.