ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Journal Article 모듈형 로봇 프레임워크에 LLM 기반 계획을 통합한 인간-로봇 상호작용의 효율화
Cited 0 time in scopus Download 27 time Share share facebook twitter linkedin kakaostory
Authors
MinHyuk Kim, JooHee Park, Kwanyong Park, Yong-Ju Lee, Sanghun Jeon
Issue Date
2026-03
Citation
Sensors, v.26, no.6, pp.1-20
ISSN
1424-8220
Publisher
Multidisciplinary Digital Publishing Institute (MDPI)
Language
English
Type
Journal Article
DOI
https://dx.doi.org/10.3390/s26061978
Abstract
Embodied artificial intelligence (AI), which integrates AI and robotics, has made significant progress, particularly in human–robot interaction, task-assisting robots, and the integration of multimodal AI models. Experimental studies have demonstrated strong performance in complex tasks, such as providing human assistance, performing household chores, and object manipulation through pick-and-place operations. However, despite these impressive capabilities, real-world applicability remains limited. While tasks such as household chores and object manipulation offer significant practical utility, users often struggle to provide effective instructions, and execution remains prohibitively slow for real-world deployment. This study introduces an approach to enhance usability through spoken human instructions and reduce operation time by streamlining intermediate steps through our Module Handler. The proposed approach leverages a large language model to extract information from spoken human instructions accurately. Through experiments, we validated the accuracy of our approach and confirmed speed improvements compared with related studies. Our experiments evaluated system accuracy in extracting relevant information from spoken human instruction, achieving an object identification accuracy rate of approximately 92.47%. In addition, our method reduced task completion times by an average of 33 s across four different experimental environments compared with existing modular robotics systems. This time reduction is significant for enhancing robotic task execution efficiency.
Keyword
embodied AI, modular robotics, large language model, human–robot interaction, task execution
KSP Keywords
Accuracy Rate, Execution Efficiency, Human assistance, Human instruction, Identification accuracy, Pick-and-place, Real-world deployment, complex task, embodied artificial intelligence, experimental study, language models
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
CC BY