Learning to Smooth with Bidirectional Predictive State Inference Machines

June 2016

Learning to Smooth with Bidirectional Predictive State Inference Machines

Authors:

Wen Sun, Roberto Capobianco, Geoffrey Gordon, J. Andrew (Drew) Bagnell, and Byron Boots

Abstract:

We present the Smoothing Machine (SMACH, pronounced “smash”), a dynamical system learning algorithm based on chain Conditional Random Fields (CRFs) with latent states. Unlike previous methods, SMACH is designed to optimize prediction performance when we have information from both past and future observations. By leveraging Predictive State Representations (PSRs), we model beliefs about latent states through predictive states—an alternative but equivalent representation that depends directly on observable quantities. Predictive states enable the use of well-developed supervised learning approaches in place of local-optimum- prone methods like EM: we learn regressors or classifiers that can approximate message passing and marginalization in the space of predictive states. We provide theoretical guarantees on smoothing performance and we empirically verify the efficacy of SMACH on several dynamical system benchmarks.
@conference{Sun-2016-5538,
author = {Wen Sun And Roberto Capobianco And Geoffrey Gordon And J. Andrew (Drew) Bagnell And Byron Boots},
title = {Learning to Smooth with Bidirectional Predictive State Inference Machines},
booktitle = {Proceedings of 32nd Conference on Uncertainty in Artificial Intelligence (UAI '16)},
year = {2016},
month = {June},
pages = {706 - 715},
publisher = {Association for Uncertainty in Artificial Intelligence (AUAI)},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.