Modular Robot Design Synthesis with Deep Reinforcement Learning

February 2020

Modular Robot Design Synthesis with Deep Reinforcement Learning

Authors:

Julian Whitman, Raunaq M. Bhirangi, Matthew J. Travers, and Howie Choset

Abstract:

Modular robots hold the promise of versatility in that their components can be re-arranged to adapt the robot design to a task at deployment time. Even for the simplest designs, determining the optimal design is exponentially complex due to the number of permutations of ways the modules can be connected. Further, when selecting the design for a given task, there is an additional computational burden in evaluating the capability of each robot, e.g., whether it can reach certain points in the workspace. This work uses deep reinforcement learning to create a search heuristic that allows us to efficiently search the space of modular serial manipulator designs. We show that our algorithm is more computationally efficient in determining robot designs for given tasks in comparison to the current state-of-the-art.
@conference{Whitman-2020-126627,
author = {Julian Whitman And Raunaq M. Bhirangi And Matthew J. Travers And Howie Choset},
title = {Modular Robot Design Synthesis with Deep Reinforcement Learning},
booktitle = {Proceedings of 34th AAAI Conference on Artificial Intelligence (AAAI '20)},
year = {2020},
month = {February},
pages = {10418 - 10425},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.