Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging

June 2018

Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging

Authors:

Brandon M. Smith, Matthew O'Toole, and Mohit Gupta
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

This paper presents techniques for tracking non-line-of-sight (NLOS) objects using speckle imaging. We develop a novel speckle formation and motion model where both the sensor and the source view objects only indirectly via a diffuse wall. We show that this NLOS imaging scenario is analogous to direct LOS imaging with the wall acting as a virtual, bare (lens-less) sensor. This enables tracking of a single, rigidly moving NLOS object using existing speckle-based motion estimation techniques. However, when imaging multiple NLOS objects, the speckle components due to different objects are superimposed on the virtual bare sensor image, and cannot be analyzed separately for recovering the motion of individual objects. We develop a novel clustering algorithm based on the statistical and geometrical properties of speckle images, which enables identifying the motion trajectories of multiple, independently moving NLOS objects. We demonstrate, for the first time, tracking individual trajectories of multiple objects around a corner with extreme precision (<; 10 microns) using only off-the-shelf imaging components.
@conference{Smith-2018-127002,
author = {Brandon M. Smith And Matthew O'Toole And Mohit Gupta},
title = {Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2018},
month = {June},
pages = {6258 - 6266},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.