BROWSE
Detail
Journal Article
AI‐based language tutoring systems with end‐to‐end automatic speech recognition and proficiency evaluation
- Authors
- Byung Ok Kang, Hyung-Bae Jeon, Yun Kyung Lee
- Issue Date
- 2024-02
- Citation
- ETRI Journal, v.46, no.1, pp.48-58
- ISSN
- 1225-6463
- Publisher
- 한국전자통신연구원
- Language
- English
- Type
- Journal Article
- Abstract
- This paper presents the development of language tutoring systems for non‐native speakers by leveraging advanced end‐to‐end automatic speech recognition (ASR) and proficiency evaluation. Given the frequent errors in non‐native speech, high‐performance spontaneous speech recognition must be applied. Our systems accurately evaluate pronunciation and speaking fluency and provide feedback on errors by relying on precise transcriptions. End‐to‐end ASR is implemented and enhanced by using diverse non‐native speaker speech data for model training. For performance enhancement, we combine semisupervised and transfer learning techniques using labeled and unlabeled speech data. Automatic proficiency evaluation is performed by a model trained to maximize the statistical correlation between the fluency score manually determined by a human expert and a calculated fluency score. We developed an English tutoring system for Korean elementary students called EBS AI PengTalk and a Korean tutoring system for foreigners called KSI Korean AI Tutor. Both systems were deployed by South Korean government agencies.
- KSP Keywords
- Elementary students, Proficiency evaluation, Statistical correlation, Transfer learning, automatic speech recognition(ASR), government agencies, native speakers, performance enhancement, spontaneous speech, tutoring system
This work is distributed under the term of Korea Open Government License (KOGL)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
