BROWSE
Detail
Journal Article
Improved Human-Object Interaction Detection through On-the-Fly Stacked Generalization
- Authors
- Geonu Lee, Kimin Yun, Jungchan Cho
- Issue Date
- 2021-03
- Citation
- IEEE Access, v.9, pp.34251-34263
- ISSN
- 2169-3536
- Publisher
- IEEE
- Language
- English
- Type
- Journal Article
- Abstract
- Human-object interaction (HOI) detection, which finds the relationships between humans and objects, is an important research area, but current HOI detection performance is unsatisfactory. One of the main problems is that CNN-based HOI detection algorithms fail to predict correct outputs for unseen test data based on a limited number of available training examples. Herein, we propose a novel framework for HOI detection called the on-the-fly stacked generalization deep neural network (OSGNet). OSGNet consists of three main components: (1) feature extraction modules, (2) HOI relationship detection networks, and (3) a meta-learner for combining the outputs of sub-models. Here, components (1) and (2) are considered to be sub-models. Any task-based feature extraction modules, such as classification or human pose estimation modules, can be used as sub-models. To achieve on-the-fly stacked generalization, the sub-models and meta-learner are trained simultaneously. The sub-models are trained to provide complementary information, and the meta-learner improves the generalization performance for unseen test data. Extensive experiments demonstrate that the proposed method achieves state-of-the-art accuracy, particularly in cases involving rare classes.
- KSP Keywords
- Deep neural network(DNN), Detection algorithm, Feature extractioN, Generalization performance, Human Pose estimation, Human-Object Interaction, Interaction detection, Stacked generalization, Sub-models, Task-Based, Test data
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
