Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer

Previously, a telepresence system, called Levitar, was proposed to allow communication through computer-graphics (CG) avatars in real space. Levitar employs micro-mirror array plates (MMAPs) to display mid-air images and optically transfer the camera viewpoint to the mid-air image-display position o...

Full description

Bibliographic Details
Main Authors: Kei Tsuchiya, Naoya Koizumi
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9347425/
_version_ 1818879927200514048
author Kei Tsuchiya
Naoya Koizumi
author_facet Kei Tsuchiya
Naoya Koizumi
author_sort Kei Tsuchiya
collection DOAJ
description Previously, a telepresence system, called Levitar, was proposed to allow communication through computer-graphics (CG) avatars in real space. Levitar employs micro-mirror array plates (MMAPs) to display mid-air images and optically transfer the camera viewpoint to the mid-air image-display position optically. This system captures the first-person view of a mid-air image avatar; however, it has a limitation that the stray light caused by MMAPs reduces its range. Therefore, in this study, we propose an optical system to capture a wider range of mid-air viewpoints. The proposed optical system uses aerial imaging by retro-reflection (AIRR) instead of MMAPs for mid-air image display and camera viewpoint transfer. AIRR is a mid-air imaging system that includes a beam splitter and retro-reflector. However, in contrast to MMAPs, it does not generate stray light. The optical transfer of the camera viewpoint by AIRR enables the capture of a large area. To evaluate the range of the capturing area when using cameras with MMAPs and AIRR, we conducted experiments under different camera gaze directions and effective angle of view. The results indicate that AIRR maintains a constant resolution up to 40° of the camera gaze direction, whereas MMAPs have a lower resolution above 30°, and the area of the marker detection rate of over 80% is approximately 54% larger for AIRR than for MMAPs. This implies that AIRR achieved a wider imaging range than MMAPs for mid-air telepresence systems.
first_indexed 2024-12-19T14:37:51Z
format Article
id doaj.art-8a232154f7964ae3aa72b9e3abc81b43
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-19T14:37:51Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-8a232154f7964ae3aa72b9e3abc81b432022-12-21T20:17:12ZengIEEEIEEE Access2169-35362021-01-019251102511710.1109/ACCESS.2021.30570569347425Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint TransferKei Tsuchiya0https://orcid.org/0000-0003-1689-5980Naoya Koizumi1https://orcid.org/0000-0002-9747-4581Department of Informatics, The University of Electro-Communications, Chofu, JapanDepartment of Informatics, The University of Electro-Communications, Chofu, JapanPreviously, a telepresence system, called Levitar, was proposed to allow communication through computer-graphics (CG) avatars in real space. Levitar employs micro-mirror array plates (MMAPs) to display mid-air images and optically transfer the camera viewpoint to the mid-air image-display position optically. This system captures the first-person view of a mid-air image avatar; however, it has a limitation that the stray light caused by MMAPs reduces its range. Therefore, in this study, we propose an optical system to capture a wider range of mid-air viewpoints. The proposed optical system uses aerial imaging by retro-reflection (AIRR) instead of MMAPs for mid-air image display and camera viewpoint transfer. AIRR is a mid-air imaging system that includes a beam splitter and retro-reflector. However, in contrast to MMAPs, it does not generate stray light. The optical transfer of the camera viewpoint by AIRR enables the capture of a large area. To evaluate the range of the capturing area when using cameras with MMAPs and AIRR, we conducted experiments under different camera gaze directions and effective angle of view. The results indicate that AIRR maintains a constant resolution up to 40° of the camera gaze direction, whereas MMAPs have a lower resolution above 30°, and the area of the marker detection rate of over 80% is approximately 54% larger for AIRR than for MMAPs. This implies that AIRR achieved a wider imaging range than MMAPs for mid-air telepresence systems.https://ieeexplore.ieee.org/document/9347425/Avatarmid-air imageviewpoint transferwide imaging range
spellingShingle Kei Tsuchiya
Naoya Koizumi
Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
IEEE Access
Avatar
mid-air image
viewpoint transfer
wide imaging range
title Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
title_full Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
title_fullStr Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
title_full_unstemmed Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
title_short Aerial Imaging by Retro-Reflection for Mid-Air Image Display and Camera Viewpoint Transfer
title_sort aerial imaging by retro reflection for mid air image display and camera viewpoint transfer
topic Avatar
mid-air image
viewpoint transfer
wide imaging range
url https://ieeexplore.ieee.org/document/9347425/
work_keys_str_mv AT keitsuchiya aerialimagingbyretroreflectionformidairimagedisplayandcameraviewpointtransfer
AT naoyakoizumi aerialimagingbyretroreflectionformidairimagedisplayandcameraviewpointtransfer