ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Conference Paper LSTC-rPPG: Long Short-Term Convolutional Network for Remote Photoplethysmography
Cited 6 time in scopus Download 120 time Share share facebook twitter linkedin kakaostory
Authors
Jun Seong Lee, Gyutae Hwang, Moonwook Ryu, Sang Jun Lee
Issue Date
2023-06
Citation
Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) 2023, pp.6014-6022
Language
English
Type
Conference Paper
DOI
https://dx.doi.org/10.1109/CVPRW59228.2023.00640
Abstract
Remote photoplethysmography (rPPG) is a non-contact technique for measuring blood pulse signals associated with cardiac activity. Although rPPG is considered an alternative to traditional contact-based photoplethysmography (PPG) because of its non-contact nature, obtaining reliable measurements remains a challenge owing to the sensitiveness of rPPG. In recent years, deep learning-based methods have improved the reliability of rPPG, but they suffer from certain limitations in utilizing long-term features such as periodic tendencies over long durations. In this paper, we propose a deep learning-based method that models long short-term spatio-temporal features and optimizes the long short-term features, ensuring reliable rPPG. The proposed method is composed of three key components: i) a deep learning architecture, denoted by LSTC-rPPG, which models long short-term spatio-temporal features and combines the features for reliable rPPG, ii) a temporal attention refinement module that mitigates temporal mismatches between the long-term and short-term features, and iii) a frequency scale invariant hybrid loss to guide long-short term features. In experiments on the UBFC-rPPG database, the proposed method demonstrated a mean absolute error of 0.7, root mean square error of 1.0, and Pearson correlation coefficient of 0.99 for heart rate estimation accuracy, outperforming contemporary state-of-the-art methods.
KSP Keywords
Cardiac activity, Convolutional networks, Estimation accuracy, Heart rate estimation, Key Components, Long-short, Mean Absolute Error, Non-contact, Pearson correlation coefficient, Reliable measurements, Root mean square(RMS)