Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems

September 2006

Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems

Authors:

Kristen Stubbs, Debra Bernstein, Kevin Crowley, and Illah Nourbakhsh

Abstract:

To help answer questions about the behavior of participants in human-robot systems, we propose the Cognitive Evaluationof Human-Robot Systems (CHERS) method based on our work with the Personal Exploration Rover (PER). The CEHRS method consists of six steps: (1) identify all system participants, (2) collect data from all participant groups, including the system's creators, (3) analyze participant data in light of system-wide goals, (4) answer targeted questions about each participant group to determine the flow of knowledge, information, and influence throughout the system, (5) look for inconsistencies in the knowledge and beliefs of different participant groups, and (5) make recommendations for improvement. We offer this comprehensive, human-centered evaluation method as a starting point for future work in understanding cognitive change in human-robot interactions.

Notes:

@conference{Stubbs-2006-9585,
author = {Kristen Stubbs And Debra Bernstein And Kevin Crowley And Illah Nourbakhsh},
title = {Cognitive Evaluation of Human-Robot Systems: A Method for Analyzing Cognitive Change in Human-Robot Systems},
booktitle = {Proceedings of 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN '06)},
year = {2006},
month = {September},
pages = {59 - 65},
publisher = {IEEE},
keywords = {human-robot interaction, cognitive change},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.