BROWSE
Detail
Journal Article
Neural Speech and Audio Coding: Modern AI technology meets traditional codecs
Cited 2 time in 
Share 
Share
- Authors
- Minje Kim, Jan Skoglund
- Issue Date
- 2024-11
- Citation
- IEEE Signal Processing Magazine, v.41, no.6, pp.85-93
- ISSN
- 1053-5888
- Publisher
- IEEE
- Language
- English
- Type
- Journal Article
- Abstract
- This article explores the integration of model-based and data-driven approaches within the realm of neural speech and audio coding systems. It highlights the challenges posed by the subjective evaluation processes of speech and audio codecs and discusses the limitations of purely data-driven approaches, which often require inefficiently large architectures to match the performance of model-based methods. The study presents hybrid systems as a viable solution, offering significant improvements to the performance of conventional codecs through meticulously chosen design enhancements. Specifically, it introduces a neural network-based signal enhancer that is designed to postprocess existing codecs' output, along with the autoencoder-based end-to-end models and LPCNet-hybrid systems that combine linear predictive coding (LPC) with neural networks. Furthermore, the article delves into predictive models that operate within custom feature spaces (TF-Codec) or predefined transform domains (MDCTNet) and examines the use of psychoacoustically calibrated loss functions to train end-to-end neural audio codecs. Through these investigations, the article demonstrates the potential of hybrid systems to advance the field of speech and audio coding by bridging the gap between traditional model-based approaches and modern data-driven techniques.
- KSP Keywords
- Coding system, Data-driven approach, Data-driven techniques, End to End(E2E), Feature space, Hybrid system, Model-based approach, Model-based method, Network-based, Performance of model, Predictive model