Learning 6-DOF Grasping Interaction via Deep 3D Geometry-aware Representations

May 2018

Learning 6-DOF Grasping Interaction via Deep 3D Geometry-aware Representations

Authors:

Xinchen Yan, Jasmine Hsu, Mohi Khansari, Yunfei Bai, Arkanath Pathak, Abhinav Gupta, James Davidson, and Honglak Lee
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

This paper focuses on the problem of learning 6-DOF grasping with a parallel jaw gripper in simulation. Compared to existing approaches that are specialized in three-dimensional grasping (i.e., top-down grasping or side-grasping), using a 6-DOF grasping model allows the robot to learn a richer set of grasping interactions given less physical constraints; hence, potentially enhancing the robustness of grasping and robot dexterity. However, learning 6-DOF grasping is challenging due to a high dimensional state space, difficulty in collecting large-scale data, and many variations of an object’s visual appearance (i.e., geometry, material, texture, and illumination). We propose the notion of a geometry-aware representation in grasping based on the assumption that knowledge of 3D geometry is at the heart of interaction. Our key idea is constraining and regularizing grasping interaction learning through 3D geometry prediction.
@conference{Yan-2018-113286,
author = {Xinchen Yan And Jasmine Hsu And Mohi Khansari And Yunfei Bai And Arkanath Pathak And Abhinav Gupta And James Davidson And Honglak Lee},
title = {Learning 6-DOF Grasping Interaction via Deep 3D Geometry-aware Representations},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2018},
month = {May},
pages = {3766 - 3773},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.