Local Property of Depth Information in 3D Images and Its Application in Feature Matching

In image registration or image matching, the feature extracted by using the traditional methods does not include the depth information which may lead to a mismatch of keypoints. In this paper, we prove that when the camera moves, the ratio of the depth difference of a keypoint and its neighbor pixel...

Full description

Bibliographic Details
Main Authors: Erbing Yang, Fei Chen, Meiqing Wang, Hang Cheng, Rong Liu
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/11/5/1154
_version_ 1797614889777233920
author Erbing Yang
Fei Chen
Meiqing Wang
Hang Cheng
Rong Liu
author_facet Erbing Yang
Fei Chen
Meiqing Wang
Hang Cheng
Rong Liu
author_sort Erbing Yang
collection DOAJ
description In image registration or image matching, the feature extracted by using the traditional methods does not include the depth information which may lead to a mismatch of keypoints. In this paper, we prove that when the camera moves, the ratio of the depth difference of a keypoint and its neighbor pixel before and after the camera movement approximates a constant. That means the depth difference of a keypoint and its neighbor pixel after normalization is invariant to the camera movement. Based on this property, all the depth differences of a keypoint and its neighbor pixels constitute a local depth-based feature, which can be used as a supplement of the traditional feature. We combine the local depth-based feature with the SIFT feature descriptor to form a new feature descriptor, and the experimental results show the feasibility and effectiveness of the new feature descriptor.
first_indexed 2024-03-11T07:18:39Z
format Article
id doaj.art-82c929ed388541b1ad8d183588240f71
institution Directory Open Access Journal
issn 2227-7390
language English
last_indexed 2024-03-11T07:18:39Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Mathematics
spelling doaj.art-82c929ed388541b1ad8d183588240f712023-11-17T08:08:58ZengMDPI AGMathematics2227-73902023-02-01115115410.3390/math11051154Local Property of Depth Information in 3D Images and Its Application in Feature MatchingErbing Yang0Fei Chen1Meiqing Wang2Hang Cheng3Rong Liu4College of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, ChinaCollege of Computer and Data Science, Fuzhou University, Fuzhou 350108, ChinaCollege of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, ChinaCollege of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, ChinaCollege of Mathematics and Statistics, Fuzhou University, Fuzhou 350108, ChinaIn image registration or image matching, the feature extracted by using the traditional methods does not include the depth information which may lead to a mismatch of keypoints. In this paper, we prove that when the camera moves, the ratio of the depth difference of a keypoint and its neighbor pixel before and after the camera movement approximates a constant. That means the depth difference of a keypoint and its neighbor pixel after normalization is invariant to the camera movement. Based on this property, all the depth differences of a keypoint and its neighbor pixels constitute a local depth-based feature, which can be used as a supplement of the traditional feature. We combine the local depth-based feature with the SIFT feature descriptor to form a new feature descriptor, and the experimental results show the feasibility and effectiveness of the new feature descriptor.https://www.mdpi.com/2227-7390/11/5/1154image registrationkeypoint matchdepth mapSIFT
spellingShingle Erbing Yang
Fei Chen
Meiqing Wang
Hang Cheng
Rong Liu
Local Property of Depth Information in 3D Images and Its Application in Feature Matching
Mathematics
image registration
keypoint match
depth map
SIFT
title Local Property of Depth Information in 3D Images and Its Application in Feature Matching
title_full Local Property of Depth Information in 3D Images and Its Application in Feature Matching
title_fullStr Local Property of Depth Information in 3D Images and Its Application in Feature Matching
title_full_unstemmed Local Property of Depth Information in 3D Images and Its Application in Feature Matching
title_short Local Property of Depth Information in 3D Images and Its Application in Feature Matching
title_sort local property of depth information in 3d images and its application in feature matching
topic image registration
keypoint match
depth map
SIFT
url https://www.mdpi.com/2227-7390/11/5/1154
work_keys_str_mv AT erbingyang localpropertyofdepthinformationin3dimagesanditsapplicationinfeaturematching
AT feichen localpropertyofdepthinformationin3dimagesanditsapplicationinfeaturematching
AT meiqingwang localpropertyofdepthinformationin3dimagesanditsapplicationinfeaturematching
AT hangcheng localpropertyofdepthinformationin3dimagesanditsapplicationinfeaturematching
AT rongliu localpropertyofdepthinformationin3dimagesanditsapplicationinfeaturematching