ETRI-Knowledge Sharing Plaform

ENGLISH

성과물

논문 검색
구분 SCI
연도 ~ 키워드

상세정보

학술지 A High-Quality VR Calibration and Real-Time Stitching Framework Using Preprocessed Features
Cited 1 time in scopus Download 0 time Share share facebook twitter linkedin kakaostory
저자
살레 사힝드, 무하마드, 조용주, 서정일, 박운상
발행일
202010
출처
IEEE Access, v.8, pp.190300-190311
ISSN
2169-3536
출판사
IEEE
DOI
https://dx.doi.org/10.1109/ACCESS.2020.3031413
협약과제
20ZH1200, 초실감 입체공간 미디어·콘텐츠 원천기술연구, 이태진
초록
Virtual Reality (VR) contents include 360-180- seamless panoramic videos, stitched from multiple overlapping video streams. Many commercial VR devices use a two-camera rig to capture VR content. These devices have increased radial distortion effects along the seams of the stitching boundary. Moreover, a fixed number of cameras in the camera rig makes the VR system non-scalable. Since the VR experience is directly related to the quality of VR content, it is desirable to create a VR framework that is scalable in terms of the number of cameras attached to the camera-rig and has better geometric and photometric quality. In this paper, we propose an end-to-end VR system for stitching full spherical content. The VR system is composed of camera rig calibration and stitching modules. The calibration module performs a geometric alignment of the camera rig. The stitching module transforms texture from the camera or video stream into the VR stream using lookup tables (LUTs) and blend masks (BMs). In this work, our main contribution is the improvement of stitching quality. First, we propose a feature preprocessing method that filters out inconsistent, error-prone features. Secondly, we propose a geometric alignment method that outperforms state-of-the-art VR stitching solutions.We tested our system on diverse image sets and obtained state-of-the-art geometric alignment. Moreover, we achieved real-time stitching of camera and video streams up to 120 fps at 4K resolution. After stitching, we encode VR content for IP multicasting.
키워드
High definition video, Multimedia systems, Real-time systems, Virtual reality
KSP 제안 키워드
Alignment method, End to End(E2E), Geometric Alignment, Geometric and photometric quality, High definition video, High-quality, IP multicasting, Multimedia systems, Panoramic video, Radial distortion, Real-time stitching