ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Journal Article Enhancing Pitch Perception and Melodic Reproduction of Hard-of-Hearing Individuals Using a Vibrotactile Glove
Cited 0 time in scopus Share share facebook twitter linkedin kakaostory
Authors
Sungyong Shin, Sunwoo Baek, Sohyun Park, Hyeonbeom Yi, Hyungcheol Shin, Woohun Lee
Issue Date
2025-02
Citation
International Journal of Human-Computer Interaction, v.권호미정, pp.1-18
ISSN
1044-7318
Publisher
Lawrence Erlbaum Associates Inc.
Language
English
Type
Journal Article
DOI
https://dx.doi.org/10.1080/10447318.2025.2452192
Abstract
The perception of pitch and engagement in melodic singing significantly contribute to the appreciation and comprehension of music. Notably, for hard-of-hearing individuals, perceiving pitch and singing play crucial roles as effective aids in auditory rehabilitation. However, the limited perception of pitch, stemming from the constraints of hearing devices, poses challenges in the learning process of recognizing and vocalizing melodies. In this study, we developed a wearable vibrotactile glove, TTS+, designed to convert musical tones into the corresponding vibrotactile patterns, complemented by an associated training application. After ten training sessions with our system, the participants exhibited notable improvements in pitch perception and the capacity to reproduce melodies through singing compared with their pre-test baseline without vibrotactile feedback. Beyond quantitative outcomes, findings from user experiences obtained through user feedback during training and post-test interviews offer valuable perspectives and constraints for our study, which may be further investigated in future studies.
KSP Keywords
Hard-of-hearing, Hearing devices, Learning Process, Post-test, User experience, User feedback, Vibrotactile Feedback, Vibrotactile glove, Vibrotactile patterns, musical tones, pre-test