Using Dialog and Human Observations to Dictate Tasks to a Learning Robot Assistant

April 2008

Using Dialog and Human Observations to Dictate Tasks to a Learning Robot Assistant

Authors:

Paul Rybski, Jeremy Stolarz, Kevin Yoon, and Manuela Veloso

Abstract:

Robot assistants need to interact with people in a natural way in order to be accepted into people’s day-to-day lives. We have been researching robot assistants with capabilities that include visually tracking humans in the environment, identifying the context in which humans carry out their activities, understanding spoken language (with a fixed vocabulary), participating in spoken dialogs to resolve ambiguities, and learning task procedures. In this paper, we describe a robot task learning algorithm in which the human explicitly and interactively instructs a series of steps to the robot through spoken language. The training algorithm fuses the robot’s perception of the human with the understood speech data, maps the spoken language to robotic actions, and follows the human to gather the action applicability state information. The robot represents the acquired task as a conditional procedure and engages the human in a spoken-language dialog to fill in information that the human may have omitted.
@article{Rybski-2008-9930,
author = {Paul Rybski And Jeremy Stolarz And Kevin Yoon And Manuela Veloso},
title = {Using Dialog and Human Observations to Dictate Tasks to a Learning Robot Assistant},
journal = {Proceedings of Journal of Intelligent Service Robots, Special Issue on Multidisciplinary Collaboration for Socially Assistive Robotics},
year = {2008},
month = {April},
volume = {1},
number = {2},
pages = {159 - 167},
keywords = {human robot interaction},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.