Matrix Completion for Weakly-supervised Multi-label Image Classification

January 2015

Matrix Completion for Weakly-supervised Multi-label Image Classification

Authors:

R. S. Cabral, F. De La Torre, J. P. Costeira, and A. Bernardino

Abstract:

In the last few years, image classification has become an incredibly active research topic, with widespread applications. Most methods for visual recognition are fully supervised, as they make use of bounding boxes or pixelwise segmentations to locate objects of interest. However, this type of manual labeling is time consuming, error prone and it has been shown that manual segmentations are not necessarily the optimal spatial enclosure for object classifiers. This paper proposes a weakly-supervised system for multi-label image classification. In this setting, training images are annotated with a set of keywords describing their contents, but the visual concepts are not explicitly segmented in the images. We formulate the weakly-supervised image classification as a low-rank matrix completion problem. Compared to previous work, our proposed framework has three advantages: (1) Unlike existing solutions based on multiple-instance learning methods, our model is convex. We propose two alternative algorithms for matrix completion specifically tailored to visual data, and prove their convergence. (2) Unlike existing discriminative methods, our algorithm is robust to labeling errors, background noise and partial occlusions. (3) Our method can potentially be used for semantic segmentation. Experimental validation on several data sets shows that our method outperforms state-of-the-art classification algorithms, while effectively capturing each class appearance.
@article{Cabral-2015-120709,
author = {R. S. Cabral And F. De La Torre And J. P. Costeira And A. Bernardino},
title = {Matrix Completion for Weakly-supervised Multi-label Image Classification},
journal = {Proceedings of IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2015},
month = {January},
volume = {37},
number = {1},
pages = {121 - 135},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.