BROWSE
Detail
Journal Article
Learning Scale-aware Relationships via Laplacian Decomposition-based Transformer for 3D Human Pose Estimation
Cited 0 time in 
Share 
Share
- Authors
- Jeonghwan Kim, Hyukmin Kwon, Seong Yong Lim, Wonjun Kim
- Issue Date
- 2024-02
- Citation
- Multimedia Systems, v.30, no.1, pp.1-20
- ISSN
- 0942-4962
- Publisher
- Springer Verlag
- Language
- English
- Type
- Journal Article
- Abstract
- This paper presents a parameter-free method for 3D human pose estimation via the Laplacian decomposition-based transformer. The non-local interactions between 3D mesh vertices of the whole body are effectively estimated in transformer-based approaches while the graph model also has begun to be embedded into the transformer for consideration of neighborhood interactions in the kinematic topology. Even though such combination has shown the remarkable progress in 3D human pose estimation, scale-aware relationships between body parts are not sufficiently explored in literature. To supplement this point, we propose to apply the Laplacian pyramid module to the transformer, which decomposes encoded features into Laplacian residuals of different scale spaces. Furthermore, we separately compute self-attentions according to body parts for generating more natural human poses. Experimental results on benchmark datasets show that the proposed method successfully improves the performance of 3D human pose estimation. The code and model are publicly available at: https://github.com/DCVL-3D/Laphormer_release .
- KSP Keywords
- 3D Mesh, 3D human pose estimation, Benchmark datasets, Body parts, Graph model, Laplacian pyramid, Non-local interactions, Parameter-free, different scales, transformer-based, whole-body