BROWSE
Detail
Journal Article
Multi-Agent Visual Reasoning for Out-of-Distribution Detection in Complex Road Environments
- Authors
- Jeonghyo Song, Kimin Yun, Dae Ung Jo, Jinyoung Kim, Youngjoon Yoo
- Issue Date
- 2025-11
- Citation
- IEEE Access, v.13, pp.188198-188216
- ISSN
- 2169-3536
- Publisher
- IEEE
- Language
- English
- Type
- Journal Article
- Abstract
- Out-of-Distribution (OOD) detection is critical for ensuring the reliability of semantic segmentation models in safety-critical autonomous driving scenarios. Despite recent advances, existing state-of-the-art OOD segmentation methods fundamentally rely on local features and suffer from a critical lack of contextual understanding in complex road environments. A representative example is distant scenes with small objects that require contextual reasoning to distinguish them from background elements. To evaluate such complex and challenging cases, we construct a dedicated subset for robustness assessment. The root cause stems from their inability to perform contextual semantic reasoning about object appropriateness in road environments. To address these fundamental limitations, we propose a novel multi-agent visual reasoning framework that leverages the powerful contextual understanding and semantic reasoning capabilities of Vision-Language Models (VLMs). Our framework decomposes the OOD detection task into specialized subtasks handled by multiple expert agents. This approach fundamentally shifts from local pattern recognition to in-context understanding-based OOD detection, enabling the system to understand not just what is anomalous, but why it is inappropriate for the given road context. Extensive experiments demonstrate that our framework significantly outperforms existing methods, particularly in challenging scenarios, while providing interpretable reasoning for safety-critical applications.
- KSP Keywords
- Complex road, Contextual reasoning, Detection task, Fundamental limitations, Local features, Local pattern, Pattern recognition, Reasoning framework, Road context, Robustness assessment, Semantic reasoning
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
