FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model

Fisheye images with a far larger Field of View (FOV) have severe radial distortion, with the result that the associated image feature matching process cannot achieve the best performance if the traditional feature descriptors are used. To address this challenge, this paper reports a novel distorted...

Full description

Bibliographic Details
Main Authors: Yutong Zhang, Jianmei Song, Yan Ding, Yating Yuan, Hua-Liang Wei
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/5/1839
_version_ 1797413101610467328
author Yutong Zhang
Jianmei Song
Yan Ding
Yating Yuan
Hua-Liang Wei
author_facet Yutong Zhang
Jianmei Song
Yan Ding
Yating Yuan
Hua-Liang Wei
author_sort Yutong Zhang
collection DOAJ
description Fisheye images with a far larger Field of View (FOV) have severe radial distortion, with the result that the associated image feature matching process cannot achieve the best performance if the traditional feature descriptors are used. To address this challenge, this paper reports a novel distorted Binary Robust Independent Elementary Feature (BRIEF) descriptor for fisheye images based on a spherical perspective model. Firstly, the 3D gray centroid of feature points is designed, and the position and direction of the feature points on the spherical image are described by a constructed feature point attitude matrix. Then, based on the attitude matrix of feature points, the coordinate mapping relationship between the BRIEF descriptor template and the fisheye image is established to realize the computation associated with the distorted BRIEF descriptor. Four experiments are provided to test and verify the invariance and matching performance of the proposed descriptor for a fisheye image. The experimental results show that the proposed descriptor works well for distortion invariance and can significantly improve the matching performance in fisheye images.
first_indexed 2024-03-09T05:12:42Z
format Article
id doaj.art-1fea1dc795e4474595dbc2fa76d93fdc
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T05:12:42Z
publishDate 2021-03-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-1fea1dc795e4474595dbc2fa76d93fdc2023-12-03T12:47:47ZengMDPI AGSensors1424-82202021-03-01215183910.3390/s21051839FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective ModelYutong Zhang0Jianmei Song1Yan Ding2Yating Yuan3Hua-Liang Wei4Key Laboratory of Dynamics and Control of Flight Vehicle, Ministry of Education, School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaKey Laboratory of Dynamics and Control of Flight Vehicle, Ministry of Education, School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaKey Laboratory of Dynamics and Control of Flight Vehicle, Ministry of Education, School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaThe Department of Applied Mathematics, The University of Waterloo, Waterloo, ON N2L 3G1, CanadaDepartment of Automatic Control and Systems Engineering, University of Sheffield, Sheffield S1 3JD, UKFisheye images with a far larger Field of View (FOV) have severe radial distortion, with the result that the associated image feature matching process cannot achieve the best performance if the traditional feature descriptors are used. To address this challenge, this paper reports a novel distorted Binary Robust Independent Elementary Feature (BRIEF) descriptor for fisheye images based on a spherical perspective model. Firstly, the 3D gray centroid of feature points is designed, and the position and direction of the feature points on the spherical image are described by a constructed feature point attitude matrix. Then, based on the attitude matrix of feature points, the coordinate mapping relationship between the BRIEF descriptor template and the fisheye image is established to realize the computation associated with the distorted BRIEF descriptor. Four experiments are provided to test and verify the invariance and matching performance of the proposed descriptor for a fisheye image. The experimental results show that the proposed descriptor works well for distortion invariance and can significantly improve the matching performance in fisheye images.https://www.mdpi.com/1424-8220/21/5/1839fisheye cameraspherical perspective modeldistorted BRIEF descriptorfeature point attitude matrix
spellingShingle Yutong Zhang
Jianmei Song
Yan Ding
Yating Yuan
Hua-Liang Wei
FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
Sensors
fisheye camera
spherical perspective model
distorted BRIEF descriptor
feature point attitude matrix
title FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
title_full FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
title_fullStr FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
title_full_unstemmed FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
title_short FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model
title_sort fsd brief a distorted brief descriptor for fisheye image based on spherical perspective model
topic fisheye camera
spherical perspective model
distorted BRIEF descriptor
feature point attitude matrix
url https://www.mdpi.com/1424-8220/21/5/1839
work_keys_str_mv AT yutongzhang fsdbriefadistortedbriefdescriptorforfisheyeimagebasedonsphericalperspectivemodel
AT jianmeisong fsdbriefadistortedbriefdescriptorforfisheyeimagebasedonsphericalperspectivemodel
AT yanding fsdbriefadistortedbriefdescriptorforfisheyeimagebasedonsphericalperspectivemodel
AT yatingyuan fsdbriefadistortedbriefdescriptorforfisheyeimagebasedonsphericalperspectivemodel
AT hualiangwei fsdbriefadistortedbriefdescriptorforfisheyeimagebasedonsphericalperspectivemodel