Gesture-Based Programming, Part 1: A Multi-Agent Approach

November 1996

Gesture-Based Programming, Part 1: A Multi-Agent Approach

Authors:

Richard Voyles and Pradeep Khosla

Abstract:

Gesture-Based Programming is a paradigm for the evolutionary programming of rapidly deployable manipulation systems by human demonstration. The goal is to provide a more natural environment for the user and to generate more complete and successful programs by focusing on task experts rather than programming experts. What makes it unique from other programming by human demonstration approaches are the same things that make it evolutionary: a composable knowledge base of expertise agents and a facility for supervised practice after initial training. Prior knowledge of previously acquired skills (sensorimotor expertise) facilitates the interpretation of "gestures" during training and then provides closed-loop control of execution during run-time. This paper, part one of two, presents a high-level description of the system as well as descriptions of capabilities we've demonstrated on a PUMA robot and Utah/MIT hand. The companion paper provides a detailed account of one method of acquiring, matching, and even transforming sensorimotor expertise.
@conference{Voyles-1996-14245,
author = {Richard Voyles And Pradeep Khosla},
title = {Gesture-Based Programming, Part 1: A Multi-Agent Approach},
booktitle = {Proceedings of Artificial Neural Networks in Engineering Conference (ANNIE '96)},
year = {1996},
month = {November},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.