Patch to the Future: Unsupervised Visual Prediction

June 2014

Patch to the Future: Unsupervised Visual Prediction

Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

In this paper we present a conceptually simple but surprisingly powerful method for visual prediction which combines the effectiveness of mid-level visual elements with temporal modeling from a decision-theoretic framework. Our framework can be learned in a completely unsupervised manner from a large collection of videos. However, more importantly, because our approach models the prediction framework on these mid-level elements, we can not only predict the possible motion in the scene but also predict visual appearances — how are appearances going to change with time. This yields a visual ”hallucination” of probable events on top of the scene. We show that our method is able to accurately predict and visualize simple future events; We also show that our approach is comparable to supervised methods for event prediction.
@conference{Walker-2014-7843,
author = {Jacob Walker And Abhinav Gupta And Martial Hebert},
title = {Patch to the Future: Unsupervised Visual Prediction},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2014},
month = {June},
pages = {3302 - 3309},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.