Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios

When producing an engaging augmented reality (AR) user experience, it is crucial to create AR content that mimics real-life objects’ behavior to the greatest extent possible. A critical aspect to achieve this is ensuring that the digital objects conform to line-of-sight rules and are either partiall...

Full description

Bibliographic Details
Main Authors: Muhammad Alfakhori, Juan Sebastián Sardi Barzallo, Volker Coors
Format: Article
Language:English
Published: MDPI AG 2023-04-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/9/4245
_version_ 1797601777081647104
author Muhammad Alfakhori
Juan Sebastián Sardi Barzallo
Volker Coors
author_facet Muhammad Alfakhori
Juan Sebastián Sardi Barzallo
Volker Coors
author_sort Muhammad Alfakhori
collection DOAJ
description When producing an engaging augmented reality (AR) user experience, it is crucial to create AR content that mimics real-life objects’ behavior to the greatest extent possible. A critical aspect to achieve this is ensuring that the digital objects conform to line-of-sight rules and are either partially or completely occluded, just like real-world objects would be. The study explores the concept of utilizing a pre-existing 3D representation of the physical environment as an occlusion mask that governs the rendering of each pixel. Specifically, the research aligns a Level of Detail (LOD) 1 building model and a 3D mesh model with their real-world counterparts and evaluates the effectiveness of occlusion between the two models in an outdoor setting. Despite the mesh model containing more detailed information, the overall results do not show improvement. In an indoor scenario, the researchers leverage the scanning capability of HoloLens 2.0 to create a pre-scanned representation, which helps overcome the limited range and delay of the mesh reconstruction.
first_indexed 2024-03-11T04:07:28Z
format Article
id doaj.art-f3b4563748ed452baf72c7b9e19be361
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T04:07:28Z
publishDate 2023-04-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-f3b4563748ed452baf72c7b9e19be3612023-11-17T23:41:43ZengMDPI AGSensors1424-82202023-04-01239424510.3390/s23094245Occlusion Handling for Mobile AR Applications in Indoor and Outdoor ScenariosMuhammad Alfakhori0Juan Sebastián Sardi Barzallo1Volker Coors2Centre for Geodesy and Geoinformatics, Stuttgart University of Applied Sciences (HFT Stuttgart), 70174 Stuttgart, GermanyCentre for Geodesy and Geoinformatics, Stuttgart University of Applied Sciences (HFT Stuttgart), 70174 Stuttgart, GermanyCentre for Geodesy and Geoinformatics, Stuttgart University of Applied Sciences (HFT Stuttgart), 70174 Stuttgart, GermanyWhen producing an engaging augmented reality (AR) user experience, it is crucial to create AR content that mimics real-life objects’ behavior to the greatest extent possible. A critical aspect to achieve this is ensuring that the digital objects conform to line-of-sight rules and are either partially or completely occluded, just like real-world objects would be. The study explores the concept of utilizing a pre-existing 3D representation of the physical environment as an occlusion mask that governs the rendering of each pixel. Specifically, the research aligns a Level of Detail (LOD) 1 building model and a 3D mesh model with their real-world counterparts and evaluates the effectiveness of occlusion between the two models in an outdoor setting. Despite the mesh model containing more detailed information, the overall results do not show improvement. In an indoor scenario, the researchers leverage the scanning capability of HoloLens 2.0 to create a pre-scanned representation, which helps overcome the limited range and delay of the mesh reconstruction.https://www.mdpi.com/1424-8220/23/9/4245augmented realitymixed realityocclusionurban planningAECHoloLens
spellingShingle Muhammad Alfakhori
Juan Sebastián Sardi Barzallo
Volker Coors
Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
Sensors
augmented reality
mixed reality
occlusion
urban planning
AEC
HoloLens
title Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
title_full Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
title_fullStr Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
title_full_unstemmed Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
title_short Occlusion Handling for Mobile AR Applications in Indoor and Outdoor Scenarios
title_sort occlusion handling for mobile ar applications in indoor and outdoor scenarios
topic augmented reality
mixed reality
occlusion
urban planning
AEC
HoloLens
url https://www.mdpi.com/1424-8220/23/9/4245
work_keys_str_mv AT muhammadalfakhori occlusionhandlingformobilearapplicationsinindoorandoutdoorscenarios
AT juansebastiansardibarzallo occlusionhandlingformobilearapplicationsinindoorandoutdoorscenarios
AT volkercoors occlusionhandlingformobilearapplicationsinindoorandoutdoorscenarios