A Model-based Gaze-tracking System

February 1997

A Model-based Gaze-tracking System

Authors:

Rainer Stiefelhagen, Jie Yang, and Alex Waibel

Abstract:

In this paper we present a non-intrusive model-based gaze tracking system. The system estimates the 3-D pose of a user's head by tracking as few as six facial feature points. The system locates a human face using a statistical color model and then finds and tracks the facial features, such as eyes, nostrils and lip corners. A full perspective model is employed to map these feature points onto the 3D pose. Several techniques have been developed to track the features points and recover from failure. We currently achieve a frame rate of 15+ frames per second using an HP 9000 workstation with a framegrabber and a Canon VC-C1 camera. The application of the system has been demonstrated by a gaze-driven panorama image viewer. The potential applications of the system include multimodal interfaces, virtual reality and video-teleconferencing.
@article{Stiefelhagen-1997-14311,
author = {Rainer Stiefelhagen And Jie Yang And Alex Waibel},
title = {A Model-based Gaze-tracking System},
journal = {Proceedings of Int. Journal of Artificial Intelligence Tools},
year = {1997},
month = {February},
volume = {6},
number = {2},
pages = {193 - 209},
keywords = {Gaze Tracking, Head Orientation, Human-Computer Interaction, Multimodal Interfaces, Facial Feature Extraction},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.