Self-Supervised Point Cloud Completion via Inpainting

November 2021

Self-Supervised Point Cloud Completion via Inpainting

Authors:

Himangi Mittal, Brian Okorn, Arpit Jangid, and David Held

Abstract:

When navigating in urban environments, many of the objects that need to be tracked and avoided are heavily occluded. Planning and tracking using these partial scans can be challenging. The aim of this work is to learn to complete these partial point clouds, giving us a full understanding of the object’s geometry using only partial observations. Previous methods achieve this with the help of complete, ground-truth annotations of the target objects, which are available only for simulated datasets. However, such ground truth is unavailable for real-world LiDAR data. In this work, we present a self-supervised point cloud completion algorithm, PointPnCNet, which is trained only on partial scans without assuming access to complete, ground-truth annotations. Our method achieves this via inpainting. We remove a portion of the input data and train the network to complete the missing region. As it is difficult to determine which regions were occluded in the initial cloud and which were synthetically removed, our network learns to complete the full cloud, including the missing regions in the initial partial cloud. We show that our method outperforms previous unsupervised and weakly-supervised methods on both the synthetic dataset, ShapeNet, and real-world LiDAR dataset, Semantic KITTI.
@conference{Mittal-2021-130283,
author = {Himangi Mittal And Brian Okorn And Arpit Jangid And David Held},
title = {Self-Supervised Point Cloud Completion via Inpainting},
booktitle = {Proceedings of British Machine Vision Conference (BMVC '21)},
year = {2021},
month = {November},
keywords = {Point Clouds, Self-Supervised Learning, Inpainting, Shapenet, KITTI, Autonomous Driving},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.