Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers

October 2008

Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers

Authors:

Abhinav Gupta and Larry S. Davis
Conference Paper
Proceedings of (ECCV) European Conference on Computer Vision

Abstract:

Learning visual classifiers for object recognition from weakly labeled data requires determining correspondence between image regions and semantic object classes. Most approaches use co-occurrence of "nouns" and image features over large datasets to determine the correspondence, but many correspondence ambiguities remain. We further constrain the correspondence problem by exploiting additional language constructs to improve the learning process from weakly labeled data. We consider both "prepositions" and "comparative adjectives" which are used to express relationships between objects. If the models of such relationships can be determined, they help resolve correspondence ambiguities. However, learning models of these relationships requires solving the correspondence problem. We simultaneously learn the visual features defining "nouns" and the differential visual features defining such "binary-relationships" using an EM-based approach.
@conference{Gupta-2008-113371,
author = {Abhinav Gupta And Larry S. Davis},
title = {Beyond Nouns: Exploiting Prepositions and Comparative Adjectives for Learning Visual Classifiers},
booktitle = {Proceedings of (ECCV) European Conference on Computer Vision},
year = {2008},
month = {October},
pages = {16 - 29},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.