Background Subtraction for Freely Moving Cameras

September 2009

Background Subtraction for Freely Moving Cameras

Authors:

Yaser Sheikh, Omar Javed, and Takeo Kanade
Conference Paper
Proceedings of (ICCV) International Conference on Computer Vision

Abstract:

Background subtraction algorithms define the background as parts of a scene that are at rest. Traditionally, these algorithms assume a stationary camera, and identify moving objects by detecting areas in a video that change over time. In this paper, we extend the concept of `subtracting' areas at rest to apply to video captured from a freely moving camera. We do not assume that the background is well-approximated by a plane or that the camera center remains stationary during motion. The method operates entirely using 2D image measurements without requiring an explicit 3D reconstruction of the scene. A sparse model of background is built by robustly estimating a compact trajectory basis from trajectories of salient features across the video, and the background is `subtracted' by removing trajectories that lie within the space spanned by the basis. Foreground and background appearance models are then built, and an optimal pixel-wise foreground/background labeling is obtained by efficiently maximizing a posterior function.
@conference{Sheikh-2009-122201,
author = {Yaser Sheikh And Omar Javed And Takeo Kanade},
title = {Background Subtraction for Freely Moving Cameras},
booktitle = {Proceedings of (ICCV) International Conference on Computer Vision},
year = {2009},
month = {September},
pages = {1219 - 1225},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.