Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360° Camera

Light field (LF)-based virtual reality (VR) systems have been proposed to tackle the problem of 360° panoramic image based VR not being able to support viewpoint movements. LF-based approaches still have shortcomings in that the user’s movement range is narrow and an extensive...

Full description

Bibliographic Details
Main Authors: Hyunmin Jung, Hyuk-Jae Lee, Chae Eun Rhee
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10132447/
_version_ 1797803154973130752
author Hyunmin Jung
Hyuk-Jae Lee
Chae Eun Rhee
author_facet Hyunmin Jung
Hyuk-Jae Lee
Chae Eun Rhee
author_sort Hyunmin Jung
collection DOAJ
description Light field (LF)-based virtual reality (VR) systems have been proposed to tackle the problem of 360&#x00B0; panoramic image based VR not being able to support viewpoint movements. LF-based approaches still have shortcomings in that the user&#x2019;s movement range is narrow and an extensive setup and high cost are required for data acquisition. This paper proposes lawn mowing pattern LF (LMP-LF) structure and presents a wide and free VR system utilizing an LMP-LF. The contributions of this paper are as follows. First, this paper proposes an LMP-LF in which several three-dimensional LFs (3DLFs) are arranged at uniform intervals. This simplifies the data acquisition process and widens the range of viewpoint movements. Second, this paper defines a light ray pair between two adjacent 3DLFs of the LMP-LF. The relationship between two light rays forming a light ray pair is expressed only with one-dimensional (1D) disparity, which greatly reduces the amount of disparity and the estimation complexity. Third, a real-time VR system using the LMP-LF is implemented and demonstrated. The proposed VR system achieves a high rendering speed of 125 frames-per-second (fps). In the prototype system, wide and free rendering performance was verified by building an LMP-LF for an automobile showroom at a size of 50m<sup>2</sup>.
first_indexed 2024-03-13T05:16:36Z
format Article
id doaj.art-d49d5890c7ac44809cb9c7fa2d85ab48
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-13T05:16:36Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-d49d5890c7ac44809cb9c7fa2d85ab482023-06-15T23:00:57ZengIEEEIEEE Access2169-35362023-01-0111575745758410.1109/ACCESS.2023.327972610132447Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; CameraHyunmin Jung0https://orcid.org/0000-0001-8216-5842Hyuk-Jae Lee1https://orcid.org/0000-0001-6811-9647Chae Eun Rhee2https://orcid.org/0000-0002-7851-1703Department of Smart ICT Convergence Engineering, Seoul National University of Science and Technology, Seoul, South KoreaDepartment of Electrical and Computer Engineering, Inter-University Semiconductor Research Center, Seoul National University, Seoul, South KoreaDepartment of Information and Communication Engineering, Inha University, Incheon, South KoreaLight field (LF)-based virtual reality (VR) systems have been proposed to tackle the problem of 360&#x00B0; panoramic image based VR not being able to support viewpoint movements. LF-based approaches still have shortcomings in that the user&#x2019;s movement range is narrow and an extensive setup and high cost are required for data acquisition. This paper proposes lawn mowing pattern LF (LMP-LF) structure and presents a wide and free VR system utilizing an LMP-LF. The contributions of this paper are as follows. First, this paper proposes an LMP-LF in which several three-dimensional LFs (3DLFs) are arranged at uniform intervals. This simplifies the data acquisition process and widens the range of viewpoint movements. Second, this paper defines a light ray pair between two adjacent 3DLFs of the LMP-LF. The relationship between two light rays forming a light ray pair is expressed only with one-dimensional (1D) disparity, which greatly reduces the amount of disparity and the estimation complexity. Third, a real-time VR system using the LMP-LF is implemented and demonstrated. The proposed VR system achieves a high rendering speed of 125 frames-per-second (fps). In the prototype system, wide and free rendering performance was verified by building an LMP-LF for an automobile showroom at a size of 50m<sup>2</sup>.https://ieeexplore.ieee.org/document/10132447/Light fieldfree viewpointvirtual realityview navigationview synthesis
spellingShingle Hyunmin Jung
Hyuk-Jae Lee
Chae Eun Rhee
Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
IEEE Access
Light field
free viewpoint
virtual reality
view navigation
view synthesis
title Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
title_full Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
title_fullStr Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
title_full_unstemmed Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
title_short Immersive Virtual Reality Content Supporting a Wide and Free Viewpoint Made With a Single 360&#x00B0; Camera
title_sort immersive virtual reality content supporting a wide and free viewpoint made with a single 360 x00b0 camera
topic Light field
free viewpoint
virtual reality
view navigation
view synthesis
url https://ieeexplore.ieee.org/document/10132447/
work_keys_str_mv AT hyunminjung immersivevirtualrealitycontentsupportingawideandfreeviewpointmadewithasingle360x00b0camera
AT hyukjaelee immersivevirtualrealitycontentsupportingawideandfreeviewpointmadewithasingle360x00b0camera
AT chaeeunrhee immersivevirtualrealitycontentsupportingawideandfreeviewpointmadewithasingle360x00b0camera