An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model

Augmented reality (AR) technology enables paper maps to dynamically express three-dimensional geographic information, realizing the fusion of virtual and real information. However, in the current mainstream AR development software, the virtual information usually consists of prefabricated components...

Full description

Bibliographic Details
Main Authors: Nixiao Zou, Qing Xu, Yuqing Wu, Xinming Zhu, Youneng Su
Format: Article
Language:English
Published: MDPI AG 2023-10-01
Series:ISPRS International Journal of Geo-Information
Subjects:
Online Access:https://www.mdpi.com/2220-9964/12/11/440
_version_ 1827639723916525568
author Nixiao Zou
Qing Xu
Yuqing Wu
Xinming Zhu
Youneng Su
author_facet Nixiao Zou
Qing Xu
Yuqing Wu
Xinming Zhu
Youneng Su
author_sort Nixiao Zou
collection DOAJ
description Augmented reality (AR) technology enables paper maps to dynamically express three-dimensional geographic information, realizing the fusion of virtual and real information. However, in the current mainstream AR development software, the virtual information usually consists of prefabricated components (prefabs), and the content creation for AR maps heavily relies on manual prefabrication. It leads to repetitive and error-prone prefabrication work, which restricts the design of the dynamic, interactive functions of AR maps. To solve this problem, this paper explored the possibility of automatically generating AR map prefabs using object detection models to establish a data conversion interface from paper maps to AR maps. First, we compared and analyzed various object detection models and selected YOLOv8x to recognize map point symbols. Then, we proposed a method to automatically generate AR map prefabs based on the predicted bounding boxes of the object detection model, which could generate prefabs with corresponding categories and positional information. Finally, we developed an AR map prototype system based on Android mobile devices. We designed an interaction method for information queries in the system to verify the effectiveness of the method proposed in this paper. The validation results indicate that our method can be practically applied to the AR map prefabrication process and can quickly generate AR map prefabs with high information accuracy. It alleviated the repetitive workload established through the manual prefabrication method and had specific feasibility and practicality. Moreover, it could provide solid data support for developing dynamic interactive functions of AR maps.
first_indexed 2024-03-09T16:47:07Z
format Article
id doaj.art-99c77e1745734dfe9d884c87a3c51e41
institution Directory Open Access Journal
issn 2220-9964
language English
last_indexed 2024-03-09T16:47:07Z
publishDate 2023-10-01
publisher MDPI AG
record_format Article
series ISPRS International Journal of Geo-Information
spelling doaj.art-99c77e1745734dfe9d884c87a3c51e412023-11-24T14:45:27ZengMDPI AGISPRS International Journal of Geo-Information2220-99642023-10-01121144010.3390/ijgi12110440An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection ModelNixiao Zou0Qing Xu1Yuqing Wu2Xinming Zhu3Youneng Su4Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, ChinaInstitute of Geospatial Information, Information Engineering University, Zhengzhou 450001, ChinaInstitute of Geospatial Information, Information Engineering University, Zhengzhou 450001, ChinaInstitute of Geospatial Information, Information Engineering University, Zhengzhou 450001, ChinaInstitute of Geospatial Information, Information Engineering University, Zhengzhou 450001, ChinaAugmented reality (AR) technology enables paper maps to dynamically express three-dimensional geographic information, realizing the fusion of virtual and real information. However, in the current mainstream AR development software, the virtual information usually consists of prefabricated components (prefabs), and the content creation for AR maps heavily relies on manual prefabrication. It leads to repetitive and error-prone prefabrication work, which restricts the design of the dynamic, interactive functions of AR maps. To solve this problem, this paper explored the possibility of automatically generating AR map prefabs using object detection models to establish a data conversion interface from paper maps to AR maps. First, we compared and analyzed various object detection models and selected YOLOv8x to recognize map point symbols. Then, we proposed a method to automatically generate AR map prefabs based on the predicted bounding boxes of the object detection model, which could generate prefabs with corresponding categories and positional information. Finally, we developed an AR map prototype system based on Android mobile devices. We designed an interaction method for information queries in the system to verify the effectiveness of the method proposed in this paper. The validation results indicate that our method can be practically applied to the AR map prefabrication process and can quickly generate AR map prefabs with high information accuracy. It alleviated the repetitive workload established through the manual prefabrication method and had specific feasibility and practicality. Moreover, it could provide solid data support for developing dynamic interactive functions of AR maps.https://www.mdpi.com/2220-9964/12/11/440AR mapobject detection modelprefabspoint symbolsdata conversion interfaceAR development software
spellingShingle Nixiao Zou
Qing Xu
Yuqing Wu
Xinming Zhu
Youneng Su
An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
ISPRS International Journal of Geo-Information
AR map
object detection model
prefabs
point symbols
data conversion interface
AR development software
title An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
title_full An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
title_fullStr An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
title_full_unstemmed An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
title_short An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model
title_sort automated method for generating prefabs of ar map point symbols based on object detection model
topic AR map
object detection model
prefabs
point symbols
data conversion interface
AR development software
url https://www.mdpi.com/2220-9964/12/11/440
work_keys_str_mv AT nixiaozou anautomatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT qingxu anautomatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT yuqingwu anautomatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT xinmingzhu anautomatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT younengsu anautomatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT nixiaozou automatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT qingxu automatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT yuqingwu automatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT xinmingzhu automatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel
AT younengsu automatedmethodforgeneratingprefabsofarmappointsymbolsbasedonobjectdetectionmodel