BROWSE
Detail
Journal Article
End-to-End Image Stitching Network via Multi-Homography Estimation
Cited 33 time in 
Share 
Share
- Authors
- Dae-Young Song, Gi-Mun Um, Hee Kyung Lee, Donghyeon Cho
- Issue Date
- 2021-04
- Citation
- IEEE Signal Processing Letters, v.28, pp.763-767
- ISSN
- 1070-9908
- Publisher
- IEEE
- Language
- English
- Type
- Journal Article
- Abstract
- In this letter, we propose an end-to-end stitching network, which takes two images with a narrow field of view (FOV) as inputs, and produces a single image with a wide FOV. Our method estimates multiple homographies to cover the depth differences in the scene and is therefore robust against parallax distortion. In particular, global warping maps are generated using estimated multiple homographies and adjusted by local displacement maps. The final result is made by warping input images multiple times using the warping maps and then merging warped images with the weight maps. Multiple homographies, local displacement maps, and weight maps are generated simultaneously by our stitching network. To train the stitching network, we construct a dataset using the CARLA simulator. Then, using this dataset, our network is trained by end-to-end supervised learning based on appearance matching loss and depth layer loss. In experiments, we show that our method is superior to existing methods both qualitatively and quantitatively. Also, we provide various empirical studies for in-depth analysis as well as the result of the expansion to 360 panoramas.
- KSP Keywords
- Displacement map, End to End(E2E), Field of View(FoV), In-depth analysis, Local displacement, Single image, Supervised Learning, Wide FOV, empirical study, homography estimation, image stitching