BROWSE
Detail
Conference Paper
Motion-Aware Heatmap Regression for Human Pose Estimation in Videos
Cited 1 time in 
Share 
Share
- Authors
- Inpyo Song, Jongmin Lee, Moonwook Ryu, Jangwon Lee
- Issue Date
- 2024-08
- Citation
- International Joint Conference on Artificial Intelligence (IJCAI) 2024, pp.1245-1253
- Language
- English
- Type
- Conference Paper
- Abstract
- We present an approach to solving 2D human pose estimation in videos. The problem of human pose estimation in videos differs from estimating human poses in static images since videos contain a lot of motion related information. Thus, we investigate how to utilize by the information of the human body movements across in a sequence of video frames for estimating human poses in videos. To do this, we introduce a novel heatmap regression method what we call motion-aware heatmap regression. Our approach computes motion vectors in joint keypoints from adjacent frames. We then design a new style of heatmap that we call Motion-Aware Heatmaps to reflect the motion uncertainty of each joint point. Unlike traditional heatmaps, our motion-aware heatmaps not only consider the current joint locations but also account how joints move over time. Furthermore, we introduce a simple yet effective framework designed to incorporate motion information into heatmap regression. We evaluate our motion-aware heatmap regression on PoseTrack(2018, 21) and Sub-JHMDB datasets. Our results validate that the proposed motion-aware heatmaps significantly improve the precision of human pose estimation in videos, particularly in challenging scenarios such as videos like sports game footage with substantial human motions. (Code and related materials are available at https://github.com/Songinpyo/MTPose).
- KSP Keywords
- Human Body, Human Pose estimation, Human motion, Joint point, Motion Vector(MV), Motion information, Over time, Poses in videos, Regression method, body movement, video frames