ETRI-Knowledge Sharing Plaform

ENGLISH

성과물

논문 검색
구분 SCI
연도 ~ 키워드

상세정보

학술대회 Tactile Tone System: AWearable Device to Assist Accuracy of Vocal Pitch in Cochlear Implant Users
Cited 4 time in scopus Download 12 time Share share facebook twitter linkedin kakaostory
저자
신승용, 오창목, 신형철
발행일
202010
출처
International Conference on Computers and Accessibility (ASSETS) 2020, pp.1-3
DOI
https://dx.doi.org/10.1145/3373625.3418008
협약과제
20HS1300, 신체기능의 이상이나 저하를 극복하기 위한 휴먼 청각 및 근력 증강 원천 기술 개발, 신형철
초록
Cochlear implantation is an effective tool in speech perception. However, activities such as listening to music and singing remain challenging for cochlear implant (CI) users, due to inaccurate pitch recognition. In this study, we propose a method for CI users to recognize precise pitch differences through tactile feedback. The proposed system encodes real-time audio signals to 36 musical tones (from C3 to B5), represented by tactile codes using nine vibration motors in a glove-type device. Two CI users participated in 15 h of training using our system and showed significant improvement in pitch accuracy while singing. In addition to the quantitative results, both participants expressed satisfaction in distinguishing and vocalizing musical tones, which led to increased interest in music. This study provides opportunities for CI users to engage more deeply and participate in musical education as well as achieve improved aural rehabilitation.
KSP 제안 키워드
Audio signal, Listening to music, Speech Perception, Tactile Feedback, cochlear implant, musical tones, real-time audio