ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Journal Article CNN Learning Strategy for Recognizing Facial Expressions
Cited 16 time in scopus Download 201 time Share share facebook twitter linkedin kakaostory
Authors
Dong-Hwan Lee, Jang-Hee Yoo
Issue Date
2023-07
Citation
IEEE Access, v.11, pp.70865-70872
ISSN
2169-3536
Publisher
Institute of Electrical and Electronics Engineers Inc.
Language
English
Type
Journal Article
DOI
https://dx.doi.org/10.1109/ACCESS.2023.3294099
Abstract
The ability to recognize facial expressions using computer vision is a crucial task that has numerous potential applications. Although deep neural networks have achieved high performance, their use in the recognition of facial expressions is still challenging. This is because different facial expressions have varying degrees of similarities among themselves, and numerous variations cause diversity in the same facial images. In this study, we propose a novel divide-and-conquer-based learning strategy to improve the performance of facial expression recognition (FER). The face area in an image was detected using MobileNet, and a ResNet-18 model was employed as a backbone deep neural network for recognizing facial expressions. Subsequently, groups containing similar facial expressions were categorized by analyzing the confusion matrix, which represents the inference results of the trained ResNet-18 model, and these similar facial expression groups were then utilized to re-train the deep learning model. In the experiments, the proposed method was evaluated using two thermal (Tufts and RWTH) and two RGB (RAF and FER2013) datasets. The results demonstrate improved FER performance, with an accuracy of 97.75% for Tufts, 86.11% for RWTH, 90.81% for RAF, and 77.83% for FER2013. As such, the proposed method can accurately classify large amounts of facial expression data.
KSP Keywords
Computer Vision(CV), Confusion matrix, Deep neural network(DNN), Divide-and-conquer, Expression data, Facial expression recognition(FER), Facial image, High performance, Learning Strategy, Potential applications, deep learning(DL)
This work is distributed under the term of Creative Commons License (CCL)
(CC BY NC ND)
CC BY NC ND