Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging

July 2022

Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging

Authors:

Soumith Udatha, Yiwei Lyu, and John M. Dolan

Abstract:

Prior work has looked at applying reinforcement learning and imitation learning approaches to autonomous driving scenarios, but either the safety or the efficiency of the algorithm is compromised.With the use of control barrier functions embedded into the reinforcement learning policy, we arrive at safe policies to optimize the performance of the autonomous driving vehicle. However, control barrier functions need a good approximation of the model of the car. We use probabilistic control barrier functions as an estimate of the model uncertainty. The algorithm is
implemented as an online version in the CARLA (Dosovitskiy et al., 2017) Simulator and as an offline version on a dataset extracted from the NGSIM Database. The proposed algorithm is not just a safe ramp merging algorithm, but a safe autonomous driving algorithm applied to address ramp merging on highways.
@workshop{Udatha-2022-144047,
author = {Soumith Udatha And Yiwei Lyu And John M. Dolan},
title = {Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging},
booktitle = {Proceedings of IJCAI Workshop on Artificial Intelligence for Autonomous Driving (AI4AD)},
year = {2022},
month = {July},
keywords = {autonomous driving, ramp merging, reinforcement learning, safe control},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.