ETRI-Knowledge Sharing Plaform

KOREAN
논문 검색
Type SCI
Year ~ Keyword

Detail

Conference Paper Fashion Small Talk: Generating Friendly Comments on the Attire of the Interacting Person by using Image Captioning Technology
Cited - time in scopus Share share facebook twitter linkedin kakaostory
Authors
Jaeyeon Lee, Dohyung Kim, Minsu Jang, Jaehong Kim
Issue Date
2020-09
Citation
International Symposium on Robot and Human Interactive Communication (RO-MAN) 2020, pp.1-2
Language
English
Type
Conference Paper
Abstract
People often start conversation with small talks like little comments on the clothes, which is far harder for robots to make than talking about specific themes. Thus it would be helpful if a robot can make friendly comments on the attire of the interacting person in building emotional bond. We thought that image captioning technology can be utilized for the purpose. In this paper, we collected images of elderly people with variety of attires and asked the annotators to generate comments that she would make if she meets them in person. Then the image captioning network was trained with the collected training data. As a result, the trained network could make relatively sensible comments on the attire of the person in the image, which can be used for the robots to initiate a friendly conversation with the user.
KSP Keywords
elderly people, image captioning, training data