Integrating Sensor Placement and Visual Tracking Strategies

October 1993

Integrating Sensor Placement and Visual Tracking Strategies

Authors:

Bradley Nelson and Pradeep Khosla

Abstract:

Real-time visual feedback is an important capability that many robotic systems must possess if these systems are to operate successfully in dynamically varying and/or uncalibrated environments. An eye-in-hand system is a common technique for providing camera motion to increase the working region of a visual sensor. Although eye-in-hand robotic systems have been well-studied, several deficiencies in proposed systems make them inadequate for actual use. Typically, the systems fail if manipulators pass through singularities or joint limits. Objects being tracked can be lost if the objects become defocused, occluded, or if features on the objects lie outside the field of view of the camera. In this paper, a technique is introduced for integrating a visual tracking strategy with dynamically determined sensor placement criteria. This allows the system to automatically determine, in real-time, proper camera motion for tracking objects successfully while accounting for the undesirable, but often unavoidable, characteristics of camera-lens and manipulator systems. The sensor placement criteria considered include focus, field-of-view, spatial resolution, manipulator configuration, and a newly introduced measure called resolvability. Experimental results are presented.
@conference{Nelson-1993-13581,
author = {Bradley Nelson And Pradeep Khosla},
title = {Integrating Sensor Placement and Visual Tracking Strategies},
booktitle = {Proceedings of 3rd International Symposium on Experimental Robotics (ISER '93)},
year = {1993},
month = {October},
pages = {167 - 181},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.