Active Clothing Material Perception using Tactile Sensing and Deep Learning

May 2018

Active Clothing Material Perception using Tactile Sensing and Deep Learning

Authors:

Wenzhen Yuan, Yuchen Mo, Shaoxiong Wang, and Edward H. Adelson
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

Humans represent and discriminate the objects in the same category using their properties, and an intelligent robot should be able to do the same. In this paper, we build a robot system that can autonomously perceive the object properties through touch. We work on the common object category of clothing. The robot moves under the guidance of an external Kinect sensor, and squeezes the clothes with a GelSight tactile sensor, then it recognizes the 11 properties of the clothing according to the tactile data. Those properties include the physical properties, like thickness, fuzziness, softness and durability, and semantic properties, like wearing season and preferred washing methods. We collect a dataset of 153 varied pieces of clothes, and conduct 6616 robot exploring iterations on them. To extract the useful information from the high-dimensional sensory output, we applied Convolutional Neural Networks (CNN) on the tactile data for recognizing the clothing properties, and on the Kinect depth images for selecting exploration locations. Experiments show that using the trained neural networks, the robot can autonomously explore the unknown clothes and learn their properties. This work proposes a new framework for active tactile perception system with vision-touch system, and has potential to enable robots to help humans with varied clothing related housework.
@conference{Yuan-2018-119918,
author = {Wenzhen Yuan And Yuchen Mo And Shaoxiong Wang And Edward H. Adelson},
title = {Active Clothing Material Perception using Tactile Sensing and Deep Learning},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2018},
month = {May},
pages = {4842 - 4849},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.