A Deep Learning-Based Stalk Grasping Pipeline

May 2018

A Deep Learning-Based Stalk Grasping Pipeline

Authors:

Tanvir Parhar, Harjatin Baweja, Merritt Jenkins, and George Kantor
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

The need for fast and precise measurements of plant attributes makes robotic solutions an ideal replacement for labor-intensive phenotyping processes. In this work we present a deep learning-based high throughput, online pipeline for in-situ sorghum stalk detection and grasping. We use a variation of Generative Adversarial Network (GAN) for stalk segmentation trained on a relatively small number of images followed by a grasp point generation pipeline. The presented pipeline is robust to field challenges such as occlusions, high stalk density and lighting variation, and was deployed on a custom-built ground robot. We tested our end-to-end system in a field of Sorghum bicolor in South Carolina, USA, achieving an average grasping accuracy of 74.13% and a stalk detection F1 score of 0.90. Grasp point detection for plant manipulation takes an average of 0.98 seconds, and pixel-wise stalk detection takes 0.2 seconds per image.
@conference{Parhar-2018-119998,
author = {Tanvir Parhar And Harjatin Baweja And Merritt Jenkins And George Kantor},
title = {A Deep Learning-Based Stalk Grasping Pipeline},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2018},
month = {May},
pages = {6161 - 6167},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.