AirObject: A Temporally Evolving Graph Embedding for Object Identification

June 2022

AirObject: A Temporally Evolving Graph Embedding for Object Identification

Authors:

Nikhil Keetha, Chen Wang, Yuheng Qiu, Kuan Xu, and Sebastian Scherer
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

Object encoding and identification are vital for robotic tasks such as autonomous exploration, semantic scene understanding, and re-localization. Previous approaches have attempted to either track objects or generate descriptors for object identification. However, such systems are limited to a "fixed" partial object representation from a single viewpoint. In a robot exploration setup, there is a requirement for a temporally "evolving" global object representation built as the robot observes the object from multiple viewpoints. Furthermore, given the vast distribution of unknown novel objects in the real world, the object identification process must be class-agnostic. In this context, we propose a novel temporal 3D object encoding approach, dubbed AirObject, to obtain global keypoint graph-based embeddings of objects. Specifically, the global 3D object embeddings are generated using a temporal convolutional network across structural information of multiple frames obtained from a graph attention-based encoding method. We demonstrate that AirObject achieves the state-of-the-art performance for video object identification and is robust to severe occlusion, perceptual aliasing, viewpoint shift, deformation, and scale transform, outperforming the state-of-the-art single-frame and sequential descriptors. To the best of our knowledge, AirObject is one of the first temporal object encoding methods. Source code is available at https://github.com/Nik-V9/AirObject.
@conference{Keetha-2022-139748,
author = {Nikhil Keetha And Chen Wang And Yuheng Qiu And Kuan Xu And Sebastian Scherer},
title = {AirObject: A Temporally Evolving Graph Embedding for Object Identification},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2022},
month = {June},
pages = {8407-8416},
publisher = {IEEE/CVF},
keywords = {Object Identification, Graph Deep Learning, Visual Recognition},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.