Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving

May 2024

Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving

Authors:

Adam Villaflor, Brian Yang, Huangyuan Su, Katerina Fragkiadaki, John M. Dolan, and Jeff Schneider
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

Significant progress has been made in training multimodal trajectory forecasting models for autonomous driving. However, effectively integrating these models with downstream planners and model-based control approaches is still an open problem. Although these models have conventionally been evaluated for open-loop prediction, we show that they can be used to parameterize autoregressive closed-loop models without retraining. We consider recent trajectory prediction approaches which leverage learned anchor embeddings to predict multiple trajectories, finding that these anchor embeddings can parameterize discrete and distinct modes representing high-level driving behaviors. We propose to perform fully reactive closed-loop planning over these discrete latent modes, allowing us to tractably model the causal interactions between agents at each step. We validate our approach on a suite of more dynamic merging scenarios, finding that our approach avoids the frozen robot problem which is pervasive in conventional planners. Our approach also outperforms the previous state-of-the-art in CARLA on challenging dense traffic scenarios when evaluated at realistic speeds.
@conference{Villaflor-2024-143681,
author = {Adam Villaflor And Brian Yang And Huangyuan Su And Katerina Fragkiadaki And John M. Dolan And Jeff Schneider},
title = {Tractable Joint Prediction and Planning over Discrete Behavior Modes for Urban Driving},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2024},
month = {May},
pages = {14785-14791},
keywords = {trajectory prediction, motion planning, multimodal, imitation learning},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.