Towards Tracking Interaction Between People

March 1998

Towards Tracking Interaction Between People

Authors:

Rainer Stiefelhagen, Jie Yang, and Alex Waibel

Abstract:

During face-to-face communication people make use of both verbal and visual behaviors. In this paper we address the problem of tracking visual cues between people. We propose a hybrid approach to tracking who is looking at whom during a discussion or meeting situation. A neural network and a model based gaze tracker are combined to track gaze directions of participants in a meeting. The neural network serves as two functions. First, the neural network coarsely detectsgaze direction of a person, i.e., determines if the person is looking at front, or left, or right, or down at the table. Second, the neural network initializes a model based gaze tracker to find out more precise gaze information when a person is in a near front view. The feasibility of the proposed approach has been demonstrated by experiments. The trained neural network has achieved classification accuracy between 82% and 97% for different people. The experimental results have shown significant improvement of robustness for the model based gaze tracker initialized by the neural network.
@conference{Stiefelhagen-1998-16549,
author = {Rainer Stiefelhagen And Jie Yang And Alex Waibel},
title = {Towards Tracking Interaction Between People},
booktitle = {Proceedings of AAAI '98 Spring Symposium on Intelligent Environments},
year = {1998},
month = {March},
pages = {123 - 127},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.