Learning to Track Multiple People in Omnidirectional Video

April 2005

Learning to Track Multiple People in Omnidirectional Video

Authors:

Fernando De La Torre Frade, Carlos Vallespi-Gonzalez, Paul Rybski, Manuela Veloso, and Takeo Kanade
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

Meetings are a very important part of everyday life for professionals working in universities, companies or governmental institutions. We have designed a physical awareness system called CAMEO (Camera Assisted Meeting Event Observer), a hardware/software system to record and monitor people's activities in meetings. CAMEO captures a high resolution omnidirectional view of the meeting by stitching images coming from almost concentric cameras. Besides recording capability, CAMEO automatically detects people and learns a person-specific facial appearance model (PSFAM) for each of the participants. The PSFAMs allow more robust/reliable tracking and identification. In this paper, we describe the video-capturing device, photometric/geometric autocalibration process, and the multiple people tracking system. The effectiveness and robustness of the proposed system is demonstrated over several real-time experiments and a large data set of videos.
@conference{Frade-2005-9143,
author = {Fernando De La Torre Frade And Carlos Vallespi-Gonzalez And Paul Rybski And Manuela Veloso And Takeo Kanade},
title = {Learning to Track Multiple People in Omnidirectional Video},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2005},
month = {April},
pages = {4150 - 4155},
keywords = {Omnidirectional-video capturing, Multiple people tracking, Subspace methods, Meeting understanding, Person-specific models.},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.