BROWSE
Detail
Journal Article
Hybrid Approach of Holography and Augmented-Reality Reconstruction Optimizations for Hyper-Reality Metaverse Video Applications
- Authors
- Hyoung Lee, Hakdong Kim, Taeheul Jun, Wookho Son, Cheongwon Kim, MinSung Yoon
- Issue Date
- 2023-12
- Citation
- IEEE Transactions on Broadcasting, v.69, no.4, pp.916-926
- ISSN
- 0018-9316
- Publisher
- Institute of Electrical and Electronics Engineers
- Language
- English
- Type
- Journal Article
- Abstract
- In this study, we offer a new type of hyper-realistic holographic display system that simultaneously displays both holographic 3D images and AR images. The proposed ultra-realistic display combines 360-degree computer generated holographic (CGH) 3D content to be reconstructed from an SLM and AR content (2D image) to be spatially projected from a microdisplay, allowing users to watch a clearly blended movie without crosstalk. To validate the proposed display’s hyper-realistic 3D image characteristics with varied depths, a ruler-based spatial depth measurement method was used to show that images appearing in the real 3D space were clearly reconstructed at different depths. Furthermore, we demonstrate that CGH content synthesized using a deep learning model that extracts high-precision depth maps from RGB color images can be successfully applied to the proposed display system through numerical and actual optical reconstruction experiments. Thus, it is possible to provide users with the effect of maximizing three-dimensional (3D) expression and natural immersion by using the new hybrid display for both free depth expression and clear hyper-realistic 3D expression. Furthermore, the accommodation effect and free-depth control characteristics demonstrated in the proposed system allow viewers to enjoy super-realistic 3D content comfortably, implying that eye fatigue may be overcome even when watching metaverse content for extended periods.
- KSP Keywords
- 2D image, 360-degree, 3D Image, 3D content, 3D space, Augmented reality(AR), Color images, Control characteristics, Depth Map, Depth measurement, Different depths
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
