Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data

Recent years have witnessed the fast development of UAVs (unmanned aerial vehicles). As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing...

Full description

Bibliographic Details
Main Authors: Xiangyu Zhuo, Tobias Koch, Franz Kurz, Friedrich Fraundorfer, Peter Reinartz
Format: Article
Language:English
Published: MDPI AG 2017-04-01
Series:Remote Sensing
Subjects:
Online Access:http://www.mdpi.com/2072-4292/9/4/376
_version_ 1798031610731298816
author Xiangyu Zhuo
Tobias Koch
Franz Kurz
Friedrich Fraundorfer
Peter Reinartz
author_facet Xiangyu Zhuo
Tobias Koch
Franz Kurz
Friedrich Fraundorfer
Peter Reinartz
author_sort Xiangyu Zhuo
collection DOAJ
description Recent years have witnessed the fast development of UAVs (unmanned aerial vehicles). As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing accuracy of UAVs is still limited by the low-performance on-board GNSS and INS. This paper investigates automatic geo-registration of an individual UAV image or UAV image blocks by matching the UAV image(s) with a previously taken georeferenced image, such as an individual aerial or satellite image with a height map attached or an aerial orthophoto with a DSM (digital surface model) attached. As the biggest challenge for matching UAV and aerial images is in the large differences in scale and rotation, we propose a novel feature matching method for nadir or slightly tilted images. The method is comprised of a dense feature detection scheme, a one-to-many matching strategy and a global geometric verification scheme. The proposed method is able to find thousands of valid matches in cases where SIFT and ASIFT fail. Those matches can be used to geo-register the whole UAV image block towards the reference image data. When the reference images offer high georeferencing accuracy, the UAV images can also be geolocalized in a global coordinate system. A series of experiments involving different scenarios was conducted to validate the proposed method. The results demonstrate that our approach achieves not only decimeter-level registration accuracy, but also comparable global accuracy as the reference images.
first_indexed 2024-04-11T20:00:29Z
format Article
id doaj.art-8db700f07efa4a95b4e19b31f4594645
institution Directory Open Access Journal
issn 2072-4292
language English
last_indexed 2024-04-11T20:00:29Z
publishDate 2017-04-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj.art-8db700f07efa4a95b4e19b31f45946452022-12-22T04:05:40ZengMDPI AGRemote Sensing2072-42922017-04-019437610.3390/rs9040376rs9040376Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image DataXiangyu Zhuo0Tobias Koch1Franz Kurz2Friedrich Fraundorfer3Peter Reinartz4Remote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, GermanyRemote Sensing Technology, Technische Universität München, 80333 Munich, GermanyRemote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, GermanyRemote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, GermanyRemote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, GermanyRecent years have witnessed the fast development of UAVs (unmanned aerial vehicles). As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing accuracy of UAVs is still limited by the low-performance on-board GNSS and INS. This paper investigates automatic geo-registration of an individual UAV image or UAV image blocks by matching the UAV image(s) with a previously taken georeferenced image, such as an individual aerial or satellite image with a height map attached or an aerial orthophoto with a DSM (digital surface model) attached. As the biggest challenge for matching UAV and aerial images is in the large differences in scale and rotation, we propose a novel feature matching method for nadir or slightly tilted images. The method is comprised of a dense feature detection scheme, a one-to-many matching strategy and a global geometric verification scheme. The proposed method is able to find thousands of valid matches in cases where SIFT and ASIFT fail. Those matches can be used to geo-register the whole UAV image block towards the reference image data. When the reference images offer high georeferencing accuracy, the UAV images can also be geolocalized in a global coordinate system. A series of experiments involving different scenarios was conducted to validate the proposed method. The results demonstrate that our approach achieves not only decimeter-level registration accuracy, but also comparable global accuracy as the reference images.http://www.mdpi.com/2072-4292/9/4/376unmanned aerial vehicleimage registrationgeo-registrationpoint cloud
spellingShingle Xiangyu Zhuo
Tobias Koch
Franz Kurz
Friedrich Fraundorfer
Peter Reinartz
Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
Remote Sensing
unmanned aerial vehicle
image registration
geo-registration
point cloud
title Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
title_full Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
title_fullStr Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
title_full_unstemmed Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
title_short Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data
title_sort automatic uav image geo registration by matching uav images to georeferenced image data
topic unmanned aerial vehicle
image registration
geo-registration
point cloud
url http://www.mdpi.com/2072-4292/9/4/376
work_keys_str_mv AT xiangyuzhuo automaticuavimagegeoregistrationbymatchinguavimagestogeoreferencedimagedata
AT tobiaskoch automaticuavimagegeoregistrationbymatchinguavimagestogeoreferencedimagedata
AT franzkurz automaticuavimagegeoregistrationbymatchinguavimagestogeoreferencedimagedata
AT friedrichfraundorfer automaticuavimagegeoregistrationbymatchinguavimagestogeoreferencedimagedata
AT peterreinartz automaticuavimagegeoregistrationbymatchinguavimagestogeoreferencedimagedata