SOLAR: Sound Object Localization and Retrieval in Complex Audio Environments

March 2005

SOLAR: Sound Object Localization and Retrieval in Complex Audio Environments

Authors:

Derek Hoiem, Yan Ke, and Rahul Sukthankar

Abstract:

The ability to identify sounds in complex audio environments is highly useful for multimedia retrieval, security, and many mobile robotic applications, but very little work has been done in this area. We present the SOLAR system, a system capable of finding sound objects, such as dog barks or car horns, in complex audio data extracted from movies. SOLAR avoids the need for segmentation by scanning over the audio data in fixed increments and classifying each short audio window separately. SOLAR employs boosted decision tree classifiers to select suitable features for modeling each sound object and to discriminate between the object of interest and all other sounds. We demonstrate the effectiveness of our approach with experiments on thirteen sound object classes trained using only tens of positive examples and tested on hours of audio data extracted from popular movies.
@conference{Hoiem-2005-9124,
author = {Derek Hoiem And Yan Ke And Rahul Sukthankar},
title = {SOLAR: Sound Object Localization and Retrieval in Complex Audio Environments},
booktitle = {Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05)},
year = {2005},
month = {March},
volume = {5},
pages = {429 - 432},
keywords = {sound detection, sound retrieval},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.