Offline Contextual Bayesian Optimization

December 2019

Offline Contextual Bayesian Optimization

Authors:

I. Char, Y. Chung, W. Neiswanger, K. Kandasamy, O. Nelson, M. Boyer, E. Kolemen, and J. Schneider
Conference Paper
Proceedings of (NeurIPS) Neural Information Processing Systems

Abstract:

In black-box optimization, an agent repeatedly chooses a configuration to test, so as to find an optimal configuration. In many practical problems of interest, one would like to optimize several systems, or "tasks", simultaneously; however, in most of these scenarios the current task is determined by nature. In this work, we explore the "offline" case in which one is able to bypass nature and choose the next task to evaluate (e.g. via a simulator). Because some tasks may be easier to optimize and others may be more critical, it is crucial to leverage algorithms that not only consider which configurations to try next, but also which tasks to make evaluations for. In this work, we describe a theoretically grounded Bayesian optimization method to tackle this problem. We also demonstrate that if the model of the reward structure does a poor job of capturing variation in difficulty between tasks, then algorithms that actively pick tasks for evaluation may end up doing more harm than good. Following this, we show how our approach can be used for real world applications in science and engineering, including optimizing tokamak controls for nuclear fusion.
@conference{Char-2019-119732,
author = {I. Char And Y. Chung And W. Neiswanger And K. Kandasamy And O. Nelson And M. Boyer And E. Kolemen And J. Schneider},
title = {Offline Contextual Bayesian Optimization},
booktitle = {Proceedings of (NeurIPS) Neural Information Processing Systems},
year = {2019},
month = {December},
pages = {4627 - 4638},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.