Unsupervised Synchrony Discovery in Human Interaction

December 2015

Unsupervised Synchrony Discovery in Human Interaction

Authors:

Wen-Sheng Chu, Jiabei Zeng, Fernando De La Torre Frade, Jeffrey Cohn, and Daniel S. Messinger
Conference Paper
Proceedings of (ICCV) International Conference on Computer Vision

Abstract:

People are inherently social. Social interaction plays an important and natural role in human behavior. Most computational methods focus on individuals alone rather than in social context. They also require labelled training data. We present an unsupervised approach to discover interpersonal synchrony, referred as to two or more persons preforming common actions in overlapping video frames or segments. For computational efficiency, we develop a branch-and-bound (B&B) approach that affords exhaustive search while guaranteeing a globally optimal solution. The proposed method is entirely general. It takes from two or more videos any multi-dimensional signal that can be represented as a histogram. We derive three novel bounding functions and provide efficient extensions, including multisynchrony detection and accelerated search, using a warmstart strategy and parallelism. We evaluate the effectiveness of our approach in multiple databases, including human actions using the CMU Mocap dataset [1], spontaneous facial behaviors using group-formation task dataset [37] and parent-infant interaction dataset [28].
@conference{Chu-2015-6047,
author = {Wen-Sheng Chu And Jiabei Zeng And Fernando De La Torre Frade And Jeffrey Cohn And Daniel S. Messinger},
title = {Unsupervised Synchrony Discovery in Human Interaction},
booktitle = {Proceedings of (ICCV) International Conference on Computer Vision},
year = {2015},
month = {December},
pages = {3146 - 3154},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.