BROWSE
Detail
Journal Article
Streamlining Human-Robot Interaction: Integrating LLM-Based Planning into Modular Robotic Frameworks
- Authors
- MinHyuk Kim, JooHee Park, Kwanyong Park, Yong-Ju Lee, Sanghun Jeon
- Issue Date
- 2026-03
- Citation
- Sensors, v.26, no.6, pp.1-20
- ISSN
- 1424-8220
- Publisher
- Multidisciplinary Digital Publishing Institute (MDPI)
- Language
- English
- Type
- Journal Article
- Abstract
- Embodied artificial intelligence (AI), which integrates AI and robotics, has made significant progress, particularly in human–robot interaction, task-assisting robots, and the integration of multimodal AI models. Experimental studies have demonstrated strong performance in complex tasks, such as providing human assistance, performing household chores, and object manipulation through pick-and-place operations. However, despite these impressive capabilities, real-world applicability remains limited. While tasks such as household chores and object manipulation offer significant practical utility, users often struggle to provide effective instructions, and execution remains prohibitively slow for real-world deployment. This study introduces an approach to enhance usability through spoken human instructions and reduce operation time by streamlining intermediate steps through our Module Handler. The proposed approach leverages a large language model to extract information from spoken human instructions accurately. Through experiments, we validated the accuracy of our approach and confirmed speed improvements compared with related studies. Our experiments evaluated system accuracy in extracting relevant information from spoken human instruction, achieving an object identification accuracy rate of approximately 92.47%. In addition, our method reduced task completion times by an average of 33 s across four different experimental environments compared with existing modular robotics systems. This time reduction is significant for enhancing robotic task execution efficiency.
- Keyword
- embodied AI, modular robotics, large language model, human–robot interaction, task execution
- KSP Keywords
- Accuracy Rate, Execution Efficiency, Human assistance, Human instruction, Human robot interaction(HRI), Identification accuracy, Modular robotic, Pick-and-place, Real-world deployment, complex task, embodied artificial intelligence
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
