Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras

June 2015

Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras

Authors:

Lei Xiao, Felix Heide, Matthew O'Toole, A. Kolb, M. Hullin, Kiriakos N. Kutulakos, and W. Heidrich
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

Continuous-wave time-of-flight (ToF) cameras show great promise as low-cost depth image sensors in mobile applications. However, they also suffer from several challenges, including limited illumination intensity, which mandates the use of large numerical aperture lenses, and thus results in a shallow depth of field, making it difficult to capture scenes with large variations in depth. Another shortcoming is the limited spatial resolution of currently available ToF sensors. In this paper we analyze the image formation model for blurred ToF images. By directly working with raw sensor measurements but regularizing the recovered depth and amplitude images, we are able to simultaneously deblur and super-resolve the output of ToF cameras. Our method outperforms existing methods on both synthetic and real datasets. In the future our algorithm should extend easily to cameras that do not follow the cosine model of continuous-wave sensors, as well as to multi-frequency or multi-phase imaging employed in more recent ToF cameras.
@conference{O'Toole-2015-127020,
author = {Lei Xiao, Felix Heide, Matthew O'Toole, A. Kolb, M. Hullin, Kiriakos N. Kutulakos, W. Heidrich},
title = {Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2015},
month = {June},
pages = {2376 - 2384},
keywords = {Cameras, Kernel, Image resolution, Apertures, Noise, Sensors, Frequency modulation},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.