Bodies at Rest: 3D Human Pose and Shape Estimation From a Pressure Image using Synthetic Data

June 2020

Bodies at Rest: 3D Human Pose and Shape Estimation From a Pressure Image using Synthetic Data

Authors:

Henry M. Clever, Zackory Erickson, Ariel Kapusta, Greg Turk, Karen Liu, and Charles C. Kemp
Conference Paper
Proceedings of (CVPR) Computer Vision and Pattern Recognition

Abstract:

People spend a substantial part of their lives at rest in bed. 3D human pose and shape estimation for this activity would have numerous beneficial applications, yet line-of-sight perception is complicated by occlusion from bedding. Pressure sensing mats are a promising alternative, but training data is challenging to collect at scale. We describe a physics-based method that simulates human bodies at rest in a bed with a pressure sensing mat, and present PressurePose, a synthetic dataset with 206K pressure images with 3D human poses and shapes. We also present PressureNet, a deep learning model that estimates human pose and shape given a pressure image and gender. PressureNet incorporates a pressure map reconstruction (PMR) network that models pressure image generation to promote consistency between estimated 3D body models and pressure image input. In our evaluations, PressureNet performed well with real data from participants in diverse poses, even though it had only been trained with synthetic data. When we ablated the PMR network, performance dropped substantially.
@conference{Clever-2020-127565,
author = {Henry M. Clever And Zackory Erickson And Ariel Kapusta And Greg Turk And Karen Liu And Charles C. Kemp},
title = {Bodies at Rest: 3D Human Pose and Shape Estimation From a Pressure Image using Synthetic Data},
booktitle = {Proceedings of (CVPR) Computer Vision and Pattern Recognition},
year = {2020},
month = {June},
pages = {6215 - 6224},
}
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.