BROWSE
Detail
Journal Article
온디바이스 소형언어모델 기술개발 동향
- Issue Date
- 2024-08
- Citation
- 전자통신동향분석, v.39, no.4, pp.82-92
- ISSN
- 1225-6455
- Publisher
- 한국전자통신연구원
- Language
- Korean
- Type
- Journal Article
- Abstract
- This paper introduces the technological development trends in on-device SLMs (Small Language Models). Large Language Models (LLMs) based on the transformer model have gained global attention with the emergence of ChatGPT, providing detailed and sophisticated responses across various knowledge domains, thereby increasing their impact across society. While major global tech companies are continuously announcing new LLMs or enhancing their capabilities, the development of SLMs, which are lightweight versions of LLMs, is intensely progressing. SLMs have the advantage of being able to run as on-device AI on smartphones or edge devices with limited memory and computing resources, enabling their application in various fields from a commercialization perspective. This paper examines the technical features for developing SLMs, lightweight technologies, semiconductor technology development trends for on-device AI, and potential applications across various industries.
- KSP Keywords
- Computing resources, Development trends, Edge devices, Knowledge domains, Language model, Lightweight technologies, Potential applications, Semiconductor technology, Technical features, technological development, transformer model
This work is distributed under the term of Korea Open Government License (KOGL)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
