Learning Shape-based Representation for Visual Localization in Extremely Changing Conditions

May 2020

Learning Shape-based Representation for Visual Localization in Extremely Changing Conditions

Authors:

Hae-Gon Jeon, Sunghoon Im, Jean Oh, and Martial Hebert
Conference Paper
Proceedings of (ICRA) International Conference on Robotics and Automation

Abstract:

Visual localization is an important task for applications such as navigation and augmented reality, but is a challenging problem when there are changes in scene appearances through day, seasons, or environments. In this paper, we present a convolutional neural network (CNN)-based approach for visual localization across normal to drastic appearance variations such as pre- and post-disaster cases. Our approach aims to address two key challenges: (1) to reduce the biases based on scene textures as in traditional CNNs, our model learns a shape-based representation by training on stylized images; (2) to make the model robust against layout changes, our approach uses the estimated dominant planes of query images as approximate scene coordinates. Our method is evaluated on various scenes including a simulated disaster dataset to demonstrate the effectiveness of our method in significant changes of scene layout. Experimental results show that our method provides reliable camera pose predictions in various changing conditions.
@conference{Jeon-2020-119357,
author = {Hae-Gon Jeon And Sunghoon Im And Jean Oh And Martial Hebert},
title = {Learning Shape-based Representation for Visual Localization in Extremely Changing Conditions},
booktitle = {Proceedings of (ICRA) International Conference on Robotics and Automation},
year = {2020},
month = {May},
pages = {7135 - 7141},
keywords = {Visual localization, deep learning, disaster scenarios},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.