Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation

Reliable image matching is the basis of image-based three-dimensional (3D) reconstruction. This study presents a quasi-dense matching method based on triangulation constraint and propagation as applied to different types of close-range image matching, such as illumination change, large viewpoint, an...

Full description

Bibliographic Details
Main Authors: Jingxue Wang, Ning Zhang, Xiangqian Wu, Weixi Wang
Format: Article
Language:English
Published: MDPI AG 2020-05-01
Series:ISPRS International Journal of Geo-Information
Subjects:
Online Access:https://www.mdpi.com/2220-9964/9/6/347
_version_ 1797566950175408128
author Jingxue Wang
Ning Zhang
Xiangqian Wu
Weixi Wang
author_facet Jingxue Wang
Ning Zhang
Xiangqian Wu
Weixi Wang
author_sort Jingxue Wang
collection DOAJ
description Reliable image matching is the basis of image-based three-dimensional (3D) reconstruction. This study presents a quasi-dense matching method based on triangulation constraint and propagation as applied to different types of close-range image matching, such as illumination change, large viewpoint, and scale change. The method begins from a set of sparse matched points that are used to construct an initial Delaunay triangulation. Edge-to-edge matching propagation is then conducted for the point matching. Two types of matching primitives from the edges of triangles with areas larger than a given threshold in the reference image, that is, the midpoints of edges and the intersections between the edges and extracted line segments, are used for the matching. A hierarchical matching strategy is adopted for the above-mentioned primitive matching. The points that cannot be matched in the first stage, specifically those that failed in a gradient orientation descriptor similarity constraint, are further matched in the second stage. The second stage combines the descriptor and the Mahalanobis distance constraints, and the optimal matching subpixel is determined according to an overall similarity score defined for the multiple constraints with different weights. Subsequently, the triangulation is updated using the newly matched points, and the aforementioned matching is repeated iteratively until no new matching points are generated. Twelve sets of close-range images are considered for the experiment. Results reveal that the proposed method has high robustness for different images and can obtain reliable matching results.
first_indexed 2024-03-10T19:34:43Z
format Article
id doaj.art-6a28dffdee9a4ed4b4e978fd846c0f87
institution Directory Open Access Journal
issn 2220-9964
language English
last_indexed 2024-03-10T19:34:43Z
publishDate 2020-05-01
publisher MDPI AG
record_format Article
series ISPRS International Journal of Geo-Information
spelling doaj.art-6a28dffdee9a4ed4b4e978fd846c0f872023-11-20T01:49:31ZengMDPI AGISPRS International Journal of Geo-Information2220-99642020-05-019634710.3390/ijgi9060347Hierarchical Point Matching Method Based on Triangulation Constraint and PropagationJingxue Wang0Ning Zhang1Xiangqian Wu2Weixi Wang3School of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaSchool of Geomatics, Liaoning Technical University, Fuxin 123000, ChinaCombat Data Laboratory, Joint Logistic Support Force of PLA, Wuhan 430010, ChinaResearch Institute of Smart Cities, School of Architecture and Urban Planning, Shenzhen University, Shenzhen 518060, ChinaReliable image matching is the basis of image-based three-dimensional (3D) reconstruction. This study presents a quasi-dense matching method based on triangulation constraint and propagation as applied to different types of close-range image matching, such as illumination change, large viewpoint, and scale change. The method begins from a set of sparse matched points that are used to construct an initial Delaunay triangulation. Edge-to-edge matching propagation is then conducted for the point matching. Two types of matching primitives from the edges of triangles with areas larger than a given threshold in the reference image, that is, the midpoints of edges and the intersections between the edges and extracted line segments, are used for the matching. A hierarchical matching strategy is adopted for the above-mentioned primitive matching. The points that cannot be matched in the first stage, specifically those that failed in a gradient orientation descriptor similarity constraint, are further matched in the second stage. The second stage combines the descriptor and the Mahalanobis distance constraints, and the optimal matching subpixel is determined according to an overall similarity score defined for the multiple constraints with different weights. Subsequently, the triangulation is updated using the newly matched points, and the aforementioned matching is repeated iteratively until no new matching points are generated. Twelve sets of close-range images are considered for the experiment. Results reveal that the proposed method has high robustness for different images and can obtain reliable matching results.https://www.mdpi.com/2220-9964/9/6/347quasi-dense matchingdescriptorMahalanobis distancetriangulation constraintmatching propagation
spellingShingle Jingxue Wang
Ning Zhang
Xiangqian Wu
Weixi Wang
Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
ISPRS International Journal of Geo-Information
quasi-dense matching
descriptor
Mahalanobis distance
triangulation constraint
matching propagation
title Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
title_full Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
title_fullStr Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
title_full_unstemmed Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
title_short Hierarchical Point Matching Method Based on Triangulation Constraint and Propagation
title_sort hierarchical point matching method based on triangulation constraint and propagation
topic quasi-dense matching
descriptor
Mahalanobis distance
triangulation constraint
matching propagation
url https://www.mdpi.com/2220-9964/9/6/347
work_keys_str_mv AT jingxuewang hierarchicalpointmatchingmethodbasedontriangulationconstraintandpropagation
AT ningzhang hierarchicalpointmatchingmethodbasedontriangulationconstraintandpropagation
AT xiangqianwu hierarchicalpointmatchingmethodbasedontriangulationconstraintandpropagation
AT weixiwang hierarchicalpointmatchingmethodbasedontriangulationconstraintandpropagation