INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS

Photorealistic three-dimensional (3D) models play an indispensable role in the spatial data infrastructure (SDI) of a smart city. Recent developments in aerial oblique photogrammetry, and the popularity of terrestrial mobile mapping systems (MMSs) offer possibilities for deriving 3D models with cent...

Full description

Bibliographic Details
Main Authors: Z. Li, B. Wu, Y. Li
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/443/2020/isprs-archives-XLIII-B2-2020-443-2020.pdf
_version_ 1819262834247204864
author Z. Li
B. Wu
Y. Li
author_facet Z. Li
B. Wu
Y. Li
author_sort Z. Li
collection DOAJ
description Photorealistic three-dimensional (3D) models play an indispensable role in the spatial data infrastructure (SDI) of a smart city. Recent developments in aerial oblique photogrammetry, and the popularity of terrestrial mobile mapping systems (MMSs) offer possibilities for deriving 3D models with centimeter-level accuracy in urban areas. Additionally, advances in image matching and bundle adjustment have allowed 3D models derived from the integration of aerial and ground imagery to overcome typical problems related to 3D mapping in urban areas (e.g., geometric defects, blurred textures on building façades). Nevertheless, this approach may not be suitable for all scenarios owing to innate differences between each platform. Besides, MMS images may not cover regions that cannot be reached by mobile vehicles in urban areas (e.g., narrow alleys, areas far from roads). Meanwhile, backpack systems have garnered attention from the photogrammetry community in recent years due to their flexibility, and regions neglected in previous works can be adequately reconstructed from images collected by backpack systems. This paper presents an approach for effectively integrating multi-source images collected by aerial, MMS, and backpack platforms for seamless 3D mapping in urban areas. The approach includes three main steps: (1) data pre-processing, (2) combined structure-from-motion, and (3) optimal generation of a textured 3D mesh model. The experimental results using aerial, MMS, and backpack datasets collected in a typical urban area in Hong Kong demonstrate the promising performance of the proposed approach. The described work is significant for boosting various types of imagery for integrated 3D mapping in both city scale and street level to facilitate various applications.
first_indexed 2024-12-23T20:03:59Z
format Article
id doaj.art-10536ab178ab44b3b68be4684f49f882
institution Directory Open Access Journal
issn 1682-1750
2194-9034
language English
last_indexed 2024-12-23T20:03:59Z
publishDate 2020-08-01
publisher Copernicus Publications
record_format Article
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
spelling doaj.art-10536ab178ab44b3b68be4684f49f8822022-12-21T17:32:59ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-202044344910.5194/isprs-archives-XLIII-B2-2020-443-2020INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREASZ. Li0B. Wu1Y. Li2Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hung Hom, Hong KongDepartment of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hung Hom, Hong KongDepartment of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hung Hom, Hong KongPhotorealistic three-dimensional (3D) models play an indispensable role in the spatial data infrastructure (SDI) of a smart city. Recent developments in aerial oblique photogrammetry, and the popularity of terrestrial mobile mapping systems (MMSs) offer possibilities for deriving 3D models with centimeter-level accuracy in urban areas. Additionally, advances in image matching and bundle adjustment have allowed 3D models derived from the integration of aerial and ground imagery to overcome typical problems related to 3D mapping in urban areas (e.g., geometric defects, blurred textures on building façades). Nevertheless, this approach may not be suitable for all scenarios owing to innate differences between each platform. Besides, MMS images may not cover regions that cannot be reached by mobile vehicles in urban areas (e.g., narrow alleys, areas far from roads). Meanwhile, backpack systems have garnered attention from the photogrammetry community in recent years due to their flexibility, and regions neglected in previous works can be adequately reconstructed from images collected by backpack systems. This paper presents an approach for effectively integrating multi-source images collected by aerial, MMS, and backpack platforms for seamless 3D mapping in urban areas. The approach includes three main steps: (1) data pre-processing, (2) combined structure-from-motion, and (3) optimal generation of a textured 3D mesh model. The experimental results using aerial, MMS, and backpack datasets collected in a typical urban area in Hong Kong demonstrate the promising performance of the proposed approach. The described work is significant for boosting various types of imagery for integrated 3D mapping in both city scale and street level to facilitate various applications.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/443/2020/isprs-archives-XLIII-B2-2020-443-2020.pdf
spellingShingle Z. Li
B. Wu
Y. Li
INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
title INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
title_full INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
title_fullStr INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
title_full_unstemmed INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
title_short INTEGRATION OF AERIAL, MMS, AND BACKPACK IMAGES FOR SEAMLESS 3D MAPPING IN URBAN AREAS
title_sort integration of aerial mms and backpack images for seamless 3d mapping in urban areas
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/443/2020/isprs-archives-XLIII-B2-2020-443-2020.pdf
work_keys_str_mv AT zli integrationofaerialmmsandbackpackimagesforseamless3dmappinginurbanareas
AT bwu integrationofaerialmmsandbackpackimagesforseamless3dmappinginurbanareas
AT yli integrationofaerialmmsandbackpackimagesforseamless3dmappinginurbanareas