BROWSE
Detail
Journal Article
Real‐time multi‐GPU‐based 8KVR stitching and streaming on 5G MEC/Cloud environments
- Authors
- HeeKyung Lee, Gi-Mun Um, Seong Yong Lim, Jeongil Seo, Moonsung Gwak
- Issue Date
- 2022-02
- Citation
- ETRI Journal, v.44, no.1, pp.62-72
- ISSN
- 1225-6463
- Publisher
- 한국전자통신연구원 (ETRI)
- Language
- English
- Type
- Journal Article
- Abstract
- In this study, we propose a multi-GPU-based 8KVR stitching system that operates in real time on both local and cloud machine environments. The proposed system first obtains multiple 4혻K video inputs, decodes them, and generates a stitched 8KVR video stream in real time. The generated 8KVR video stream can be downloaded and rendered omnidirectionally in player apps on smartphones, tablets, and head-mounted displays. To speed up processing, we adopt group-of-pictures-based distributed decoding/encoding and buffering with the NV12 format, along with multi-GPU-based parallel processing. Furthermore, we develop several algorithms such as equirectangular projection-based color correction, real-time CG overlay, and object motion-based seam estimation and correction, to improve the stitching quality. From experiments in both local and cloud machine environments, we confirm the feasibility of the proposed 8KVR stitching system with stitching speed of up to 83.7 fps for six-channel and 62.7 fps for eight-channel inputs. In addition, in an 8KVR live streaming test on the 5G MEC/cloud, the proposed system achieves stable performances with 8혻K@30 fps in both indoor and outdoor environments, even during motion.
- KSP Keywords
- Color correction, Distributed decoding, GPU-based, Head mounted displays(HMD), Indoor and outdoor environments, Motion-based, Multi-GPU, Object motion, Parallel Processing, Real-time, Speed-up
This work is distributed under the term of Korea Open Government License (KOGL)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
(Type 4: : Type 1 + Commercial Use Prohibition+Change Prohibition)
