Detecting Depression Severity by Interpretable Representations of Motion Dynamics

May 2018

Detecting Depression Severity by Interpretable Representations of Motion Dynamics

Authors:

A. Kacem, Z. Hammal, M. Daoudi, and J. Cohn

Abstract:

Recent breakthroughs in deep learning using automated measurement of face and head motion have made possible the first objective measurement of depression severity. While powerful, deep learning approaches lack interpretability. We developed an interpretable method of automatically measuring depression severity that uses barycentric coordinates of facial landmarks and a Lie-algebra based rotation matrix of 3D head motion. Using these representations, kinematic features are extracted, preprocessed, and encoded using Gaussian Mixture Models (GMM) and Fisher vector encoding. A multi-class SVM is used to classify the encoded facial and head movement dynamics into three levels of depression severity. The proposed approach was evaluated in adults with history of chronic depression. The method approached the classification accuracy of state-of-the-art deep learning while enabling clinically and theoretically relevant findings. The velocity and acceleration of facial movement strongly mapped onto depression severity symptoms consistent with clinical data and theory.
@conference{Kacem-2018-120226,
author = {A. Kacem And Z. Hammal And M. Daoudi And J. Cohn},
title = {Detecting Depression Severity by Interpretable Representations of Motion Dynamics},
booktitle = {Proceedings of 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG '18)},
year = {2018},
month = {May},
pages = {739 - 745},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.