Nonparametric Representation of Policies and Value Functions: A Trajectory-Based Approach

December 2002

Nonparametric Representation of Policies and Value Functions: A Trajectory-Based Approach

Authors:

Chris Atkeson and Jun Morimoto
Conference Paper
Proceedings of (NeurIPS) Neural Information Processing Systems

Abstract:

A longstanding goal of reinforcement learning is to develop nonparametric representations of policies and value functions that support rapid learning without suffering from interference or the curse of dimensionality. We have developed a trajectory-based approach, in which policies and value functions are represented nonparametrically along trajectories. These trajectories, policies, and value functions are updated as the value function becomes more accurate or as a model of the task is updated. We have applied this approach to periodic tasks such as hopping and walking, which required handling discount factors and discontinuities in the task dynamics, and using function approximation to represent value functions at discontinuities. We also describe extensions of the approach to make the policies more robust to modeling error and sensor noise.
@conference{Atkeson-2002-16864,
author = {Chris Atkeson And Jun Morimoto},
title = {Nonparametric Representation of Policies and Value Functions: A Trajectory-Based Approach},
booktitle = {Proceedings of (NeurIPS) Neural Information Processing Systems},
year = {2002},
month = {December},
pages = {1643 - 1650},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.