SCALE: Causal Learning and Discovery of Robot Manipulation Skills using Simulation

November 2023

SCALE: Causal Learning and Discovery of Robot Manipulation Skills using Simulation

Authors:

Tabitha Edith Lee, Shivam Vats, Siddharth Girdhar, and Oliver Kroemer
Conference Paper
Proceedings of (CoRL) Conference on Robot Learning

Abstract:

We propose SCALE, an approach for discovering and learning a diverse set of interpretable robot skills from a limited dataset. Rather than learning a single skill which may fail to capture all the modes in the data, we first identify the different modes via causal reasoning and learn a separate skill for each of them. Our main insight is to associate each mode with a unique set of causally relevant context variables that are discovered by performing causal interventions in simulation. This enables data partitioning based on the causal processes that generated the data, and then compressed skills that ignore the irrelevant variables can be trained. We model each robot skill as a Regional Compressed Option, which extends the options framework by associating a causal process and its relevant variables with the option. Modeled as the skill Data Generating Region, each causal process is local in nature and hence valid over only a subset of the context space. We demonstrate our approach for two representative manipulation tasks: block stacking and peg-in-hole insertion under uncertainty. Our experiments show that our approach yields diverse skills that are compact, robust to domain shifts, and suitable for sim-to-real transfer.

Notes:

Tabitha Edith Lee and Shivam Vats contributed equally to this work.
@conference{Lee-Vats-2023-138873,
author = {Tabitha Edith Lee And Shivam Vats And Siddharth Girdhar And Oliver Kroemer},
title = {SCALE: Causal Learning and Discovery of Robot Manipulation Skills using Simulation},
booktitle = {Proceedings of (CoRL) Conference on Robot Learning},
year = {2023},
month = {November},
keywords = {skill discovery, causal learning, manipulation},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.