Gesture-Based Programming for Robotics: Human Augmented Software Adaptation

November 1999

Gesture-Based Programming for Robotics: Human Augmented Software Adaptation

Authors:

Richard Voyles, James Morrow, and Pradeep Khosla

Abstract:

Gesture-Based Programming is a paradigm for programming robots by human demonstration in which the human demonstrator directs the self-adaptation of executable software. The goal is to provide a more natural environment for the user as programmer and to generate more complete and successful programs by focusing on task experts rather than programming experts. We call the paradigm "gesture-based" because we try to enable the system to capture, in real-time, the intention behind the demonstrator's fleeting, context-dependent hand motions, contact conditions, finger poses, and even cryptic utterances in order to reconfigure itself. The system is self-adaptive in the sense that knowledge of previously acquired skills (sensorimotor expertise) is retained by the system and this knowledge facilitates the interpretation of the gestures during training and then provides feedback control during run-time.
@article{Voyles-1999-16726,
author = {Richard Voyles And James Morrow And Pradeep Khosla},
title = {Gesture-Based Programming for Robotics: Human Augmented Software Adaptation},
journal = {Proceedings of IEEE Intelligent Systems and their Applications},
year = {1999},
month = {November},
volume = {14},
number = {6},
pages = {22 - 29},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.