PoseFlow: A deep motion representation for understanding human behaviors in videos

June 2018

PoseFlow: A deep motion representation for understanding human behaviors in videos

Authors:

Dingwen Zhang, Guangyu Guo, Dong Huang, and Junwei Han
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

Motion of the human body is the critical cue for understanding and characterizing human behavior in videos. Most existing approaches explore the motion cue using optical flows. However, optical flow usually contains motion on both the interested human bodies and the undesired background. This" noisy" motion representation makes it very challenging for pose estimation and action recognition in real scenarios. To address this issue, this paper presents a novel deep motion representation, called PoseFlow, which reveals human motion in videos while suppressing background and motion blur, and being robust to occlusion. For learning PoseFlow with mild computational cost, we propose a functionally structured spatial-temporal deep network, PoseFlow Net (PFN), to jointly solve the skeleton localization and matching problems of PoseFlow. Comprehensive experiments show that PFN outperforms the state-of-the-art deep flow estimation models in generating PoseFlow. Moreover, PoseFlow demonstrates its potential on improving two challenging tasks in human video analysis: pose estimation and action recognition.
@conference{Zhang-2018-112459,
author = {Dingwen Zhang And Guangyu Guo And Dong Huang And Junwei Han},
title = {PoseFlow: A deep motion representation for understanding human behaviors in videos},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2018},
month = {June},
pages = {6762 - 6770},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.