Optical Computing for Fast Light Transport Analysis

December 2010

Optical Computing for Fast Light Transport Analysis

Authors:

Matthew O'Toole and Kiriakos N. Kutulakos

Abstract:

We present a general framework for analyzing the transport matrix of a real-world scene at full resolution, without capturing many photos. The key idea is to use projectors and cameras to directly acquire eigenvectors and the Krylov subspace of the unknown transport matrix. To do this, we implement Krylov subspace methods partially in optics, by treating the scene as a "black box subroutine" that enables optical computation of arbitrary matrix-vector products. We describe two methods---optical Arnoldi to acquire a low-rank approximation of the transport matrix for relighting; and optical GMRES to invert light transport. Our experiments suggest that good quality relighting and transport inversion are possible from a few dozen low-dynamic range photos, even for scenes with complex shadows, caustics, and other challenging lighting effects.

Notes:

Supplemental Material (42.8 MB) Available for Download at: https://dl.acm.org/doi/10.1145/1882261.1866165
@article{O'Toole-2010-127031,
author = {Matthew O'Toole And Kiriakos N. Kutulakos},
title = {Optical Computing for Fast Light Transport Analysis},
journal = {Proceedings of ACM Transactions on Graphics (TOG)},
year = {2010},
month = {December},
volume = {29},
number = {6},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.