Obstacle Avoidance through Deep Networks based Intermediate Perception

April 2017

Obstacle Avoidance through Deep Networks based Intermediate Perception

Authors:

Yang S, Konam S, Ma C, Rosenthal S, Veloso M, and Scherer S

Abstract:

Obstacle avoidance from monocular images is a challenging problem for robots. Though multi-view structure-from-motion could build 3D maps, it is not robust in textureless environments. Some learning based methods exploit human demonstration to predict a steering command directly from a single image. However, this method is usually biased towards certain tasks or demonstration scenarios and also biased by human understanding. In this paper, we propose a new method to predict a trajectory from images. We train our system on more diverse NYUv2 dataset. The ground truth trajectory is computed from the designed cost functions automatically. The Convolutional Neural Network perception is divided into two stages: first, predict depth map and surface normal from RGB images, which are two important geometric properties related to 3D obstacle representation. Second, predict the trajectory from the depth and normal. Results show that our intermediate perception increases the accuracy by 20% than the direct prediction. Our model generalizes well to other public indoor datasets and is also demonstrated for robot flights in simulation and experiments.
@article{Yang-2017-139798,
author = {Yang S, Konam S, Ma C, Rosenthal S, Veloso M, Scherer S},
title = {Obstacle Avoidance through Deep Networks based Intermediate Perception},
journal = {Proceedings of arXiv preprint arXiv:1704. 08759},
year = {2017},
month = {April},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.