BROWSE
Detail
Conference Paper
BOVIS: Bias-Mitigated Object-Enhanced Visual Emotion Analysis
- Authors
- Yubeen Lee, Sangeun Lee, Junyeop Cha, Jufeng Yang, Eunil Park
- Issue Date
- 2025-11
- Citation
- International Conference on Information and Knowledge Management (CIKM) 2025, pp.1508-1518
- Language
- English
- Type
- Conference Paper
- Abstract
- Visual emotion analysis is a promising field that aims to predict emotional responses elicited by visual stimuli. While recent advances in deep learning have significantly improved emotion detection capabilities, existing methods often fall short because of their exclusive focus on either holistic visual features or semantic content, thereby neglecting their interplay. To address this limitation, we introduce BOVIS, a Bias-Mitigated Object-Enhanced Visual Emotion Analysis framework. To capture the subtle relationships between visual and semantic features and enrich the understanding of emotional contexts, BOVIS leverages pre-trained models to extract comprehensive image features, integrate object-level semantics, and enhance contextual information. Moreover, BOVIS incorporates a bias mitigation strategy that involves an adjusted Mean Absolute Error loss function alongside an Inverse Probability Weighting method to address dataset imbalances and enhance fairness in emotion prediction. Comprehensive evaluations across various benchmark datasets demonstrate the effectiveness of the BOVIS framework in enhancing visual emotion analysis. The results reveal that the synergy between object-specific features and holistic visual representations improves the accuracy and interpretability of emotion analysis, while optimizing bias mitigation enhances fairness and increases reliability. The code is available at https://github.com/leeyubin10/BOVIS.git.
- KSP Keywords
- Benchmark datasets, Contextual information, Emotion analysis, Emotional Responses, Image Features, Inverse probability weighting, Mean Absolute Error, Mitigation strategy, Object-level, Semantic content, Specific features
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
