Self-paced Mixture of Regressions

August 2017

Self-paced Mixture of Regressions

Authors:

Longfei Han, Dingwen Zhang, Dong Huang, Xiaojun Chang, Jun Ren, Senlin Luo, and Junwei Han

Abstract:

Mixture of regressions (MoR) is the wellestablished and effective approach to model discontinuous and heterogeneous data in regression problems. Existing MoR approaches assume smooth joint distribution for its good anlaytic properties. However, such assumption makes existing MoR very sensitive to intra-component outliers (the noisy training data residing in certain components) and the inter-component imbalance (the different amounts of training data in different components). In this paper, we make the earliest effort on Self-paced Learning (SPL) in MoR, ie, Self-paced mixture of regressions (SPMoR) model. We propose a novel selfpaced regularizer based on the Exclusive LASSO, which improves inter-component balance of training data. As a robust learning regime, SPL pursues confidence sample reasoning. To demonstrate the effectiveness of SPMoR, we conducted experiments on both the sythetic examples and real-world applications to age estimation and glucose estimation. The results show that SPMoR outperforms the stateof-the-arts methods.
@conference{Han-2017-126373,
author = {Longfei Han And Dingwen Zhang And Dong Huang And Xiaojun Chang And Jun Ren And Senlin Luo And Junwei Han},
title = {Self-paced Mixture of Regressions},
booktitle = {Proceedings of 26th International Joint Conference on Artificial Intelligence (IJCAI '17)},
year = {2017},
month = {August},
pages = {1816 - 1822},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.