Programmable Non-Epipolar Indirect Light Transport: Capture and Analysis

April 2021

Programmable Non-Epipolar Indirect Light Transport: Capture and Analysis

Authors:

H. Kubo, S. Jayasuriya, T. Iwaguchi, T. Funatomi, Y. Mukaigawa, and S. G. Narasimhan

Abstract:

The decomposition of light transport into direct and global components, diffuse and specular interreflections, and subsurface scattering allows for new visualizations of light in everyday scenes. In particular, indirect light contains a myriad of information about the complex appearance of materials useful for computer vision and inverse rendering applications. In this paper, we present a new imaging technique that captures and analyzes components of indirect light via light transport using a synchronized projector-camera system. The rectified system illuminates the scene with epipolar planes corresponding to projector rows, and we vary two key parameters to capture plane-to-ray light transport between projector row and camera pixel: (1)the offset between projector row and camera row in the rolling shutter, and (2)the exposure of the camera row. We describe how this synchronized rolling shutter performs illumination multiplexing, and develop a nonlinear optimization algorithm to demultiplex the resulting 3D light transport operator. Using our system, we are able to capture live short and long-range indirect light transport, disambiguate subsurface scattering, diffuse and specular interreflections, and distinguish materials according to their subsurface scattering properties. In particular, we show the utility of indirect imaging for capturing and analyzing the hidden structure of veins in human skin.
@article{Kubo-2021-120189,
author = {H. Kubo And S. Jayasuriya And T. Iwaguchi And T. Funatomi And Y. Mukaigawa And S. G. Narasimhan},
title = {Programmable Non-Epipolar Indirect Light Transport: Capture and Analysis},
journal = {Proceedings of IEEE Transactions on Visualization and Computer Graphics},
year = {2021},
month = {April},
volume = {27},
number = {4},
pages = {2421 - 2436},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.