Task Level Training Signals for Learning Controllers

August 1994

Task Level Training Signals for Learning Controllers

Authors:

J. G. Schneider and C. M. Brown

Abstract:

Presents a new learning controller and compares it to feedback error learning on the problem of tracking with the tip of an inverted pendulum. This problem captures the important aspects of motor skills: difficult job, unstable plant, with premium placed on accuracy, efficiency, and speed of performance. The new controller abandons a traditional feedback error learning restriction and uses plant state as part of the learning process in order to retain better generalization to new curves. More importantly, it considers a new way ("coaching") to provide a target signal for training. A coach views entire task executions to create target control signals rather than using only instantaneous error and state information at each time step. In the authors' experiments, the new controller is able to track faster trajectories than plain feedback error learning.
@conference{Schneider-1994-119833,
author = {J. G. Schneider And C. M. Brown},
title = {Task Level Training Signals for Learning Controllers},
booktitle = {Proceedings of 9th IEEE International Symposium on Intelligent Control (ISIC '94)},
year = {1994},
month = {August},
pages = {45 - 50},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.