Reinforcement Learning: A Survey

May 1996

Reinforcement Learning: A Survey

Authors:

L. P. Kaelbling, M. L. Littman, and Andrew Moore

Abstract:

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of current work are summarized. Reinforcement learning is the problem faced by an agent that learns behavior through trial-and-error interactions with a dynamic environment. The work described here has a resemblance to work in psychology, but differs considerably in the details and in the use of the word ``reinforcement.'' The paper discusses central issues of reinforcement learning, including trading off exploration and exploitation, establishing the foundations of the field via Markov decision theory, learning from delayed reinforcement, constructing empirical models to accelerate learning, making use of generalization and hierarchy, and coping with hidden state. It concludes with a survey of some implemented systems and an assessment of the practical utility of current methods for reinforcement learning.
@article{Kaelbling-1996-16308,
author = {L. P. Kaelbling And M. L. Littman And Andrew Moore},
title = {Reinforcement Learning: A Survey},
journal = {Proceedings of Journal of Artificial Intelligence Research},
year = {1996},
month = {May},
volume = {4},
pages = {237 - 285},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.