ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction

To improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error corre...

Full description

Bibliographic Details
Main Authors: Chengxian Yao, Haifeng Zhang, Jia Zhu, Diqing Fan, Yu Fang, Lin Tang
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10159369/
_version_ 1797792187489976320
author Chengxian Yao
Haifeng Zhang
Jia Zhu
Diqing Fan
Yu Fang
Lin Tang
author_facet Chengxian Yao
Haifeng Zhang
Jia Zhu
Diqing Fan
Yu Fang
Lin Tang
author_sort Chengxian Yao
collection DOAJ
description To improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error correction. Firstly, when establishing the feature scale pyramid, the method of using the same patch-size for description on each feature layer is adopted instead of using different patch-sizes on a unified feature layer in the original algorithm, which enhances the robustness of the descriptor and improves the matching accuracy. Secondly, FAST-SCORE maps are established on different scales, and the coordinates of high-level feature points mapped to the bottom layer are corrected to further improve the positioning accuracy of feature points. The algorithm is verified in remote sensing images, autonomous driving, and industrial automation fields. Experimental results show that when resisting theoretical interference, the average matching accuracy of the proposed algorithm is 67.9%, which is about 2.0 times that of the ORB algorithm, and the average stability is 14.0, which is about 1.5 times that of the ORB algorithm. After correcting the feature point mapping, the matching accuracy can be further improved by 19.2%, indicating that the improved algorithm has excellent robustness when resisting interference. In the experiments on the KITTI and custom datasets, the matching accuracy of the proposed algorithm reached 88.70% and 96.88%, respectively, which is an improvement of 10.15% and 1.2% compared to the ORB algorithm. At the same time, the matching time was reduced by 17.34% and 24.30%, ensuring the accuracy and real-time performance of the algorithm in practical scenarios.
first_indexed 2024-03-13T02:29:36Z
format Article
id doaj.art-d8943c112d9a4e0ca3036d5d89df698d
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-13T02:29:36Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-d8943c112d9a4e0ca3036d5d89df698d2023-06-29T23:00:19ZengIEEEIEEE Access2169-35362023-01-0111638086382010.1109/ACCESS.2023.328859410159369ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error CorrectionChengxian Yao0https://orcid.org/0009-0000-0895-3197Haifeng Zhang1https://orcid.org/0000-0002-7449-3560Jia Zhu2https://orcid.org/0000-0002-3951-950XDiqing Fan3Yu Fang4https://orcid.org/0000-0002-0971-6860Lin Tang5School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, ChinaTo improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error correction. Firstly, when establishing the feature scale pyramid, the method of using the same patch-size for description on each feature layer is adopted instead of using different patch-sizes on a unified feature layer in the original algorithm, which enhances the robustness of the descriptor and improves the matching accuracy. Secondly, FAST-SCORE maps are established on different scales, and the coordinates of high-level feature points mapped to the bottom layer are corrected to further improve the positioning accuracy of feature points. The algorithm is verified in remote sensing images, autonomous driving, and industrial automation fields. Experimental results show that when resisting theoretical interference, the average matching accuracy of the proposed algorithm is 67.9%, which is about 2.0 times that of the ORB algorithm, and the average stability is 14.0, which is about 1.5 times that of the ORB algorithm. After correcting the feature point mapping, the matching accuracy can be further improved by 19.2%, indicating that the improved algorithm has excellent robustness when resisting interference. In the experiments on the KITTI and custom datasets, the matching accuracy of the proposed algorithm reached 88.70% and 96.88%, respectively, which is an improvement of 10.15% and 1.2% compared to the ORB algorithm. At the same time, the matching time was reduced by 17.34% and 24.30%, ensuring the accuracy and real-time performance of the algorithm in practical scenarios.https://ieeexplore.ieee.org/document/10159369/Feature matchingmachine visionimage processingORB
spellingShingle Chengxian Yao
Haifeng Zhang
Jia Zhu
Diqing Fan
Yu Fang
Lin Tang
ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
IEEE Access
Feature matching
machine vision
image processing
ORB
title ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
title_full ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
title_fullStr ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
title_full_unstemmed ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
title_short ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
title_sort orb feature matching algorithm based on multi scale feature description fusion and feature point mapping error correction
topic Feature matching
machine vision
image processing
ORB
url https://ieeexplore.ieee.org/document/10159369/
work_keys_str_mv AT chengxianyao orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection
AT haifengzhang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection
AT jiazhu orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection
AT diqingfan orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection
AT yufang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection
AT lintang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection