Modeling communicative behaviors for object references in human-robot interaction

May 2016

Modeling communicative behaviors for object references in human-robot interaction

Authors:

Henny Admoni, Thomas Weng, and Brian Scassellati
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

This paper presents a model that uses a robot's verbal and nonverbal behaviors to successfully communicate object references to a human partner. This model, which is informed by computer vision, human-robot interaction, and cognitive psychology, simulates how low-level and high-level features of the scene might draw a user's attention. It then selects the most appropriate robot behavior that maximizes the likelihood that a user will understand the correct object reference while minimizing the cost of the behavior. We present a general computational framework for this model, then describe a specific implementation in a human-robot collaboration. Finally, we analyze the model's performance in two human evaluations-one video-based (75 participants) and one in person (20 participants)-and demonstrate that the system predicts the correct behaviors to perform successful object references.
@conference{Admoni-2016-113236,
author = {Henny Admoni And Thomas Weng And Brian Scassellati},
title = {Modeling communicative behaviors for object references in human-robot interaction},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2016},
month = {May},
pages = {3352 - 3359},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.