A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information

Achieving seamless integration between virtual objects and real scenes has always been an important issue in augmented reality (AR) research. To achieve this, it is necessary to provide virtual objects with real-time and accurate lighting conditions from a real scene. Therefore, the purpose of this...

Full description

Bibliographic Details
Main Authors: Kunpeng Zhu, Shuo Liu, Weichao Sun, Yixin Yuan, Yuang Wu
Format: Article
Language:English
Published: MDPI AG 2023-08-01
Series:ISPRS International Journal of Geo-Information
Subjects:
Online Access:https://www.mdpi.com/2220-9964/12/8/324
_version_ 1797584475795750912
author Kunpeng Zhu
Shuo Liu
Weichao Sun
Yixin Yuan
Yuang Wu
author_facet Kunpeng Zhu
Shuo Liu
Weichao Sun
Yixin Yuan
Yuang Wu
author_sort Kunpeng Zhu
collection DOAJ
description Achieving seamless integration between virtual objects and real scenes has always been an important issue in augmented reality (AR) research. To achieve this, it is necessary to provide virtual objects with real-time and accurate lighting conditions from a real scene. Therefore, the purpose of this study is to realize lighting consistency rendering for real-time AR systems in outdoor environments, aiming to enhance the user’s sense of immersion. In this paper, we propose a lighting consistency technique for real-time AR systems in outdoor environments based on multi-source geographical information (MGI). Specifically, we introduce MGI into the study of lighting consistency and construct a comprehensive database to store and manage the acquired MGI data. Based on this, we proposed a sky radiance model driven using the MGI. Finally, we utilized the sky radiance model along with light sensor data to render the virtual objects in outdoor scenes. The experimental results show that the shadow angular error is reduced to 5.2°, and the system frame rate is increased to 94.26. This means that our method achieves a high level of realism in the fusion of virtual objects and real scenes while ensuring a high frame rate in the system. With this technology, users can conveniently and extensively realize the lighting consistency rendering of real-time AR systems in outdoor scenes using mobile devices.
first_indexed 2024-03-10T23:53:12Z
format Article
id doaj.art-3b432b96dcbe44fcb568c9067fe45a6b
institution Directory Open Access Journal
issn 2220-9964
language English
last_indexed 2024-03-10T23:53:12Z
publishDate 2023-08-01
publisher MDPI AG
record_format Article
series ISPRS International Journal of Geo-Information
spelling doaj.art-3b432b96dcbe44fcb568c9067fe45a6b2023-11-19T01:23:53ZengMDPI AGISPRS International Journal of Geo-Information2220-99642023-08-0112832410.3390/ijgi12080324A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-InformationKunpeng Zhu0Shuo Liu1Weichao Sun2Yixin Yuan3Yuang Wu4National Engineering Research Center for Geomatics (NCG), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, ChinaNational Engineering Research Center for Geomatics (NCG), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, ChinaNational Engineering Research Center for Geomatics (NCG), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, ChinaNational Engineering Research Center for Geomatics (NCG), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, ChinaNational Engineering Research Center for Geomatics (NCG), Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, ChinaAchieving seamless integration between virtual objects and real scenes has always been an important issue in augmented reality (AR) research. To achieve this, it is necessary to provide virtual objects with real-time and accurate lighting conditions from a real scene. Therefore, the purpose of this study is to realize lighting consistency rendering for real-time AR systems in outdoor environments, aiming to enhance the user’s sense of immersion. In this paper, we propose a lighting consistency technique for real-time AR systems in outdoor environments based on multi-source geographical information (MGI). Specifically, we introduce MGI into the study of lighting consistency and construct a comprehensive database to store and manage the acquired MGI data. Based on this, we proposed a sky radiance model driven using the MGI. Finally, we utilized the sky radiance model along with light sensor data to render the virtual objects in outdoor scenes. The experimental results show that the shadow angular error is reduced to 5.2°, and the system frame rate is increased to 94.26. This means that our method achieves a high level of realism in the fusion of virtual objects and real scenes while ensuring a high frame rate in the system. With this technology, users can conveniently and extensively realize the lighting consistency rendering of real-time AR systems in outdoor scenes using mobile devices.https://www.mdpi.com/2220-9964/12/8/324GISmulti-source geo-informationaugmented realitylight consistencyreal-time
spellingShingle Kunpeng Zhu
Shuo Liu
Weichao Sun
Yixin Yuan
Yuang Wu
A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
ISPRS International Journal of Geo-Information
GIS
multi-source geo-information
augmented reality
light consistency
real-time
title A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
title_full A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
title_fullStr A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
title_full_unstemmed A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
title_short A Lighting Consistency Technique for Outdoor Augmented Reality Systems Based on Multi-Source Geo-Information
title_sort lighting consistency technique for outdoor augmented reality systems based on multi source geo information
topic GIS
multi-source geo-information
augmented reality
light consistency
real-time
url https://www.mdpi.com/2220-9964/12/8/324
work_keys_str_mv AT kunpengzhu alightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT shuoliu alightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT weichaosun alightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT yixinyuan alightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT yuangwu alightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT kunpengzhu lightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT shuoliu lightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT weichaosun lightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT yixinyuan lightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation
AT yuangwu lightingconsistencytechniqueforoutdooraugmentedrealitysystemsbasedonmultisourcegeoinformation