Hilbert Space Embeddings of Conditional Distributions with Applications to Dynamical Systems

June 2009

Hilbert Space Embeddings of Conditional Distributions with Applications to Dynamical Systems

Authors:

Le Song, Jonathan Huang, Alex Smola, and Kenji Fukumizu
Conference Paper
Proceedings of (ICML) International Conference on Machine Learning

Abstract:

In this paper, we extend the Hilbert space embedding approach to handle conditional distributions. We derive a kernel estimate for the conditional embedding, and show its connection to ordinary embeddings. Conditional embeddings largely extend our ability to manipulate distributions in Hibert spaces, and as an example, we derive a nonparametric method for modeling dynamical systems where the belief state of the system is maintained as a conditional embedding. Our method is very general in terms of both the domains and the types of distributions that it can handle, and we demonstrate the effectiveness of our method in various dynamical systems. We expect that conditional embeddings will have wider applications beyond modeling dynamical systems.
@conference{Song-2009-10243,
author = {Le Song And Jonathan Huang And Alex Smola And Kenji Fukumizu},
title = {Hilbert Space Embeddings of Conditional Distributions with Applications to Dynamical Systems},
booktitle = {Proceedings of (ICML) International Conference on Machine Learning},
year = {2009},
month = {June},
pages = {961 - 968},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.