Learning to Filter with Predictive State Inference Machines

June 2016

Learning to Filter with Predictive State Inference Machines

Authors:

Wen Sun, Arun Venkatraman, Byron Boots, and J. Andrew (Drew) Bagnell
Conference Paper
Proceedings of (ICML) International Conference on Machine Learning

Abstract:

Latent state space models are a fundamental and widely used tool for modeling dynamical systems. However, they are difficult to learn from data and learned models often lack performance guarantees on inference tasks such as filtering and prediction. In this work, we present the PREDICTIVE STATE INFERENCE MACHINE (PSIM), a data-driven method that considers the inference procedure on a dynamical system as a composition of predictors. The key idea is that rather than first learning a latent state space model, and then using the learned model for inference, PSIM directly learns predictors for inference in predictive state space. We provide theoretical guarantees for inference, in both realizable and agnostic settings, and showcase practical performance on a variety of simulated and real world robotics benchmarks.
@conference{Sun-2016-5539,
author = {Wen Sun And Arun Venkatraman And Byron Boots And J. Andrew (Drew) Bagnell},
title = {Learning to Filter with Predictive State Inference Machines},
booktitle = {Proceedings of (ICML) International Conference on Machine Learning},
year = {2016},
month = {June},
pages = {1197 - 1205},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.