Just Go With the Flow: Self-Supervised Scene Flow Estimation

June 2020

Just Go With the Flow: Self-Supervised Scene Flow Estimation

Authors:

Himangi Mittal, Brian Okorn, and David Held
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

When interacting with highly dynamic environments, scene flow allows autonomous systems to reason about the non-rigid motion of multiple independent objects. This is of particular interest in the field of autonomous driving, in which many cars, people, bicycles, and other objects need to be accurately tracked. Current state-of-the-art methods require annotated scene flow data from autonomous driving scenes to train scene flow networks with supervised learning. As an alternative, we present a method of training scene flow that uses two self-supervised losses, based on nearest neighbors and cycle consistency. These self-supervised losses allow us to train our method on large unlabeled autonomous driving datasets; the resulting method matches current state-of-the-art supervised performance using no real world annotations and exceeds state-of-the-art performance when combining our self-supervised approach with supervised learning on a smaller labeled dataset.
@conference{Mittal-2020-122637,
author = {Himangi Mittal And Brian Okorn And David Held},
title = {Just Go With the Flow: Self-Supervised Scene Flow Estimation},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2020},
month = {June},
pages = {11174 - 11182},
keywords = {Scene Flow, Self-Supervised, Point Clouds, KITTI, nuScenes, Autonomous Driving},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.