BROWSE
Detail
Conference Paper
Progressive Query Refinement Framework for Bird’s-Eye-View Semantic Segmentation from Surrounding Images
Cited 0 time in 
Share 
Share
- Authors
- Dooseop Choi, Jungyu Kang, Taeghyun An, Kyounghwan Ahn, KyoungWook Min
- Issue Date
- 2024-10
- Citation
- International Conference on Intelligent Robots and Systems (IROS) 2024, pp.10806-10811
- Publisher
- IEEE
- Language
- English
- Type
- Conference Paper
- Abstract
- Expressing images with Multi-Resolution (MR) features has been widely adopted in many computer vision tasks. In this paper, we introduce the MR concept into Bird's-Eye-View (BEV) semantic segmentation for autonomous driving. This introduction enhances our model's ability to capture both global and local characteristics of driving scenes through our proposed residual learning. Specifically, given a set of MR BEV query maps, the lowest resolution query map is initially updated using a View Transformation (VT) encoder. This updated query map is then upscaled and merged with a higher resolution query map to undergo further updates in a subsequent VT encoder. This process is repeated until the resolution of the updated query map reaches the target. Finally, the lowest resolution map is added to the target resolution to generate the final query map. During training, we enforce both the lowest and final query maps to align with the ground-truth BEV semantic map to help our model effectively capture the global and local characteristics. We also propose a visual feature interaction network that promotes interactions between features across images and across feature levels, thus highly contributing to the performance improvement. We evaluate our model on a large-scale real-world dataset. The experimental results show that our model outperforms the SOTA models in terms of IoU metric. Codes are available at https://github.com/d1024choi/ProgressiveQueryReneNet
- KSP Keywords
- Computer Vision(CV), Eye-View, Feature Interaction, Global and local, Ground Truth, Interaction networks, Local characteristics, Multi-resolution, Real-world, Semantic segmentation, Visual Features