Active Transfer Learning under Model Shift

June 2014

Active Transfer Learning under Model Shift

Authors:

X. Wang, T. Huang, and J. Schneider
Conference Paper
Proceedings of (ICML) International Conference on Machine Learning

Abstract:

Transfer learning algorithms are used when one has sufficient training data for one supervised learning task (the source task) but only very limited training data for a second task (the target task) that is similar but not identical to the first. These algorithms use varying assumptions about the similarity between the tasks to carry information from the source to the target task. Common assumptions are that only certain specific marginal or conditional distributions have changed while all else remains the same. Alternatively, if one has only the target task, but also has the ability to choose a limited amount of additional training data to collect, then active learning algorithms are used to make choices which will most improve performance on the target task. These algorithms may be combined into active transfer learning, but previous efforts have had to apply the two methods in sequence or use restrictive transfer assumptions. We propose two transfer learning algorithms that allow changes in all marginal and conditional distributions but assume the changes are smooth in order to achieve transfer between the tasks. We then propose an active learning algorithm for the second method that yields a combined active transfer learning algorithm. We demonstrate the algorithms on synthetic functions and a real-world task on estimating the yield of vineyards from images of the grapes.
@conference{Wang-2014-119782,
author = {X. Wang And T. Huang And J. Schneider},
title = {Active Transfer Learning under Model Shift},
booktitle = {Proceedings of (ICML) International Conference on Machine Learning},
year = {2014},
month = {June},
volume = {32},
pages = {1305 - 1313},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.