Tuning neural networks with stochastic optimization

September 1997

Tuning neural networks with stochastic optimization

Authors:

A. Dubrawski
Conference Paper
Proceedings of (IROS) IEEE/RSJ International Conference on Intelligent Robots and Systems

Abstract:

This paper describes a method for automated tuning of hyper-parameters of supervised learning systems. It emerges from stochastic aproximation, uses memory-based learning principles, follows certain ideas of experimental design and employs a particular approach to resampling called stochastic validation. Potential usefulness of the proposed approach is illustrated with the fuzzy-ARTMAP neural network application to learning a qualitative positioning of an indoor mobile robot equipped with ultrasonic range sensors. Automatically selected setpoints allow the system to reach a similar or better performance in comparison to that achieved by human experts in all studied cases. The presented method may serve as a design tool in practical applications of supervised learning algorithms.
@conference{Dubrawski-1997-121908,
author = {A. Dubrawski},
title = {Tuning neural networks with stochastic optimization},
booktitle = {Proceedings of (IROS) IEEE/RSJ International Conference on Intelligent Robots and Systems},
year = {1997},
month = {September},
volume = {2},
pages = {614 - 620},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.