Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes

September 2019

Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes

Authors:

C. Wang, S. Lucey, F. Perazzi, and O. Wang

Abstract:

We present a fully data-driven method to compute depth from diverse monocular video sequences that contain large amounts of non-rigid objects, e.g., people. In order to learn reconstruction cues for non-rigid scenes, we introduce a new dataset consisting of stereo videos scraped in-the-wild. This dataset has a wide variety of scene types, and features large amounts of nonrigid objects, especially people. From this, we compute disparity maps to be used as supervision to train our approach. We propose a loss function that allows us to generate a depth prediction even with unknown camera intrinsics and stereo baselines in the dataset. We validate the use of large amounts of Internet video by evaluating our method on existing video datasets with depth supervision, including SINTEL, and KITTI, and show that our approach generalizes better to natural scenes.
@conference{Wang-2019-121007,
author = {C. Wang And S. Lucey And F. Perazzi And O. Wang},
title = {Web Stereo Video Supervision for Depth Prediction from Dynamic Scenes},
booktitle = {Proceedings of International Conference on 3D Vision (3DV '19)},
year = {2019},
month = {September},
pages = {348 - 357},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.