Robust Task-based Control Policies for Physics-based Characters

December 2009

Robust Task-based Control Policies for Physics-based Characters

Authors:

Stelian Coros, Philippe Beaudoin, and Michiel Van De Panne

Abstract:

We present a method for precomputing robust task-based control policies for physically simulated characters. This allows for characters that can demonstrate skill and purpose in completing a given task, such as walking to a target location, while physically interacting with the environment in significant ways. As input, the method assumes an abstract action vocabulary consisting of balance-aware, step-based controllers. A novel constrained state exploration phase is first used to define a character dynamics model as well as a finite volume of character states over which the control policy will be defined. An optimized control policy is then computed using reinforcement learning. The final policy spans the cross-product of the character state and task state, and is more robust than the conrollers it is constructed from. We demonstrate real-time results for six locomotion-based tasks and on three highly-varied bipedal characters. We further provide a game-scenario demonstration.

Notes:

Project Page
@conference{Coros-2009-17078,
author = {Stelian Coros And Philippe Beaudoin And Michiel Van De Panne},
title = {Robust Task-based Control Policies for Physics-based Characters},
booktitle = {Proceedings of ACM Transactions on Graphics (TOG)},
year = {2009},
month = {December},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.