Epipolar Rectification with Minimum Perspective Distortion for Oblique Images

Epipolar rectification is of great importance for 3D modeling by using UAV (Unmanned Aerial Vehicle) images; however, the existing methods seldom consider the perspective distortion relative to surface planes. Therefore, an algorithm for the rectification of oblique images is proposed and implemente...

Full description

Bibliographic Details
Main Authors: Jianchen Liu, Bingxuan Guo, Wanshou Jiang, Weishu Gong, Xiongwu Xiao
Format: Article
Language:English
Published: MDPI AG 2016-11-01
Series:Sensors
Subjects:
Online Access:http://www.mdpi.com/1424-8220/16/11/1870
_version_ 1818007613698211840
author Jianchen Liu
Bingxuan Guo
Wanshou Jiang
Weishu Gong
Xiongwu Xiao
author_facet Jianchen Liu
Bingxuan Guo
Wanshou Jiang
Weishu Gong
Xiongwu Xiao
author_sort Jianchen Liu
collection DOAJ
description Epipolar rectification is of great importance for 3D modeling by using UAV (Unmanned Aerial Vehicle) images; however, the existing methods seldom consider the perspective distortion relative to surface planes. Therefore, an algorithm for the rectification of oblique images is proposed and implemented in detail. The basic principle is to minimize the rectified images’ perspective distortion relative to the reference planes. First, this minimization problem is formulated as a cost function that is constructed by the tangent value of angle deformation; second, it provides a great deal of flexibility on using different reference planes, such as roofs and the façades of buildings, to generate rectified images. Furthermore, a reasonable scale is acquired according to the dihedral angle between the rectified image plane and the original image plane. The low-quality regions of oblique images are cropped out according to the distortion size. Experimental results revealed that the proposed rectification method can result in improved matching precision (Semi-global dense matching). The matching precision is increased by about 30% for roofs and increased by just 1% for façades, while the façades are not parallel to the baseline. In another designed experiment, the selected façades are parallel to the baseline, the matching precision has a great improvement for façades, by an average of 22%. This fully proves our proposed algorithm that elimination of perspective distortion on rectified images can significantly improve the accuracy of dense matching.
first_indexed 2024-04-14T05:17:56Z
format Article
id doaj.art-e53377fa4eec46e1938a18481d48223e
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-14T05:17:56Z
publishDate 2016-11-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-e53377fa4eec46e1938a18481d48223e2022-12-22T02:10:18ZengMDPI AGSensors1424-82202016-11-011611187010.3390/s16111870s16111870Epipolar Rectification with Minimum Perspective Distortion for Oblique ImagesJianchen Liu0Bingxuan Guo1Wanshou Jiang2Weishu Gong3Xiongwu Xiao4School of Remote Sensing and Information Engineering, Wuhan University, 129 Luoyu Road, Wuhan 430079, ChinaState key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, ChinaState key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, ChinaDepartment of Geographical Sciences, University of Maryland, 2181 Samuel J. LeFrak Hall, 7251 Preinkert Drive, College Park, MD 20742, USAState key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, 129 Luoyu Road, Wuhan 430079, ChinaEpipolar rectification is of great importance for 3D modeling by using UAV (Unmanned Aerial Vehicle) images; however, the existing methods seldom consider the perspective distortion relative to surface planes. Therefore, an algorithm for the rectification of oblique images is proposed and implemented in detail. The basic principle is to minimize the rectified images’ perspective distortion relative to the reference planes. First, this minimization problem is formulated as a cost function that is constructed by the tangent value of angle deformation; second, it provides a great deal of flexibility on using different reference planes, such as roofs and the façades of buildings, to generate rectified images. Furthermore, a reasonable scale is acquired according to the dihedral angle between the rectified image plane and the original image plane. The low-quality regions of oblique images are cropped out according to the distortion size. Experimental results revealed that the proposed rectification method can result in improved matching precision (Semi-global dense matching). The matching precision is increased by about 30% for roofs and increased by just 1% for façades, while the façades are not parallel to the baseline. In another designed experiment, the selected façades are parallel to the baseline, the matching precision has a great improvement for façades, by an average of 22%. This fully proves our proposed algorithm that elimination of perspective distortion on rectified images can significantly improve the accuracy of dense matching.http://www.mdpi.com/1424-8220/16/11/1870epipolar rectificationoblique imagesUAV imagesminimum perspective distortion3D reconstruction
spellingShingle Jianchen Liu
Bingxuan Guo
Wanshou Jiang
Weishu Gong
Xiongwu Xiao
Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
Sensors
epipolar rectification
oblique images
UAV images
minimum perspective distortion
3D reconstruction
title Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
title_full Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
title_fullStr Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
title_full_unstemmed Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
title_short Epipolar Rectification with Minimum Perspective Distortion for Oblique Images
title_sort epipolar rectification with minimum perspective distortion for oblique images
topic epipolar rectification
oblique images
UAV images
minimum perspective distortion
3D reconstruction
url http://www.mdpi.com/1424-8220/16/11/1870
work_keys_str_mv AT jianchenliu epipolarrectificationwithminimumperspectivedistortionforobliqueimages
AT bingxuanguo epipolarrectificationwithminimumperspectivedistortionforobliqueimages
AT wanshoujiang epipolarrectificationwithminimumperspectivedistortionforobliqueimages
AT weishugong epipolarrectificationwithminimumperspectivedistortionforobliqueimages
AT xiongwuxiao epipolarrectificationwithminimumperspectivedistortionforobliqueimages