ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction
To improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error corre...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2023-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10159369/ |
_version_ | 1797792187489976320 |
---|---|
author | Chengxian Yao Haifeng Zhang Jia Zhu Diqing Fan Yu Fang Lin Tang |
author_facet | Chengxian Yao Haifeng Zhang Jia Zhu Diqing Fan Yu Fang Lin Tang |
author_sort | Chengxian Yao |
collection | DOAJ |
description | To improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error correction. Firstly, when establishing the feature scale pyramid, the method of using the same patch-size for description on each feature layer is adopted instead of using different patch-sizes on a unified feature layer in the original algorithm, which enhances the robustness of the descriptor and improves the matching accuracy. Secondly, FAST-SCORE maps are established on different scales, and the coordinates of high-level feature points mapped to the bottom layer are corrected to further improve the positioning accuracy of feature points. The algorithm is verified in remote sensing images, autonomous driving, and industrial automation fields. Experimental results show that when resisting theoretical interference, the average matching accuracy of the proposed algorithm is 67.9%, which is about 2.0 times that of the ORB algorithm, and the average stability is 14.0, which is about 1.5 times that of the ORB algorithm. After correcting the feature point mapping, the matching accuracy can be further improved by 19.2%, indicating that the improved algorithm has excellent robustness when resisting interference. In the experiments on the KITTI and custom datasets, the matching accuracy of the proposed algorithm reached 88.70% and 96.88%, respectively, which is an improvement of 10.15% and 1.2% compared to the ORB algorithm. At the same time, the matching time was reduced by 17.34% and 24.30%, ensuring the accuracy and real-time performance of the algorithm in practical scenarios. |
first_indexed | 2024-03-13T02:29:36Z |
format | Article |
id | doaj.art-d8943c112d9a4e0ca3036d5d89df698d |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-03-13T02:29:36Z |
publishDate | 2023-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-d8943c112d9a4e0ca3036d5d89df698d2023-06-29T23:00:19ZengIEEEIEEE Access2169-35362023-01-0111638086382010.1109/ACCESS.2023.328859410159369ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error CorrectionChengxian Yao0https://orcid.org/0009-0000-0895-3197Haifeng Zhang1https://orcid.org/0000-0002-7449-3560Jia Zhu2https://orcid.org/0000-0002-3951-950XDiqing Fan3Yu Fang4https://orcid.org/0000-0002-0971-6860Lin Tang5School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai, ChinaSchool of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, ChinaTo improve the accuracy of feature extraction and description of various scales in traditional Oriented FAST and Rotated BRIEF (ORB) feature matching algorithm, this paper proposes an ORB feature matching algorithm based on multi-scale feature description fusion and feature point mapping error correction. Firstly, when establishing the feature scale pyramid, the method of using the same patch-size for description on each feature layer is adopted instead of using different patch-sizes on a unified feature layer in the original algorithm, which enhances the robustness of the descriptor and improves the matching accuracy. Secondly, FAST-SCORE maps are established on different scales, and the coordinates of high-level feature points mapped to the bottom layer are corrected to further improve the positioning accuracy of feature points. The algorithm is verified in remote sensing images, autonomous driving, and industrial automation fields. Experimental results show that when resisting theoretical interference, the average matching accuracy of the proposed algorithm is 67.9%, which is about 2.0 times that of the ORB algorithm, and the average stability is 14.0, which is about 1.5 times that of the ORB algorithm. After correcting the feature point mapping, the matching accuracy can be further improved by 19.2%, indicating that the improved algorithm has excellent robustness when resisting interference. In the experiments on the KITTI and custom datasets, the matching accuracy of the proposed algorithm reached 88.70% and 96.88%, respectively, which is an improvement of 10.15% and 1.2% compared to the ORB algorithm. At the same time, the matching time was reduced by 17.34% and 24.30%, ensuring the accuracy and real-time performance of the algorithm in practical scenarios.https://ieeexplore.ieee.org/document/10159369/Feature matchingmachine visionimage processingORB |
spellingShingle | Chengxian Yao Haifeng Zhang Jia Zhu Diqing Fan Yu Fang Lin Tang ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction IEEE Access Feature matching machine vision image processing ORB |
title | ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction |
title_full | ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction |
title_fullStr | ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction |
title_full_unstemmed | ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction |
title_short | ORB Feature Matching Algorithm Based on Multi-Scale Feature Description Fusion and Feature Point Mapping Error Correction |
title_sort | orb feature matching algorithm based on multi scale feature description fusion and feature point mapping error correction |
topic | Feature matching machine vision image processing ORB |
url | https://ieeexplore.ieee.org/document/10159369/ |
work_keys_str_mv | AT chengxianyao orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection AT haifengzhang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection AT jiazhu orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection AT diqingfan orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection AT yufang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection AT lintang orbfeaturematchingalgorithmbasedonmultiscalefeaturedescriptionfusionandfeaturepointmappingerrorcorrection |