An Infrared-Visible Image Registration Method Based on the Constrained Point Feature
It is difficult to find correct correspondences for infrared and visible image registration because of different imaging principles. Traditional registration methods based on the point feature require designing the complicated feature descriptor and eliminate mismatched points, which results in unsa...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-02-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/4/1188 |
| _version_ | 1797412799929909248 |
|---|---|
| author | Qingqing Li Guangliang Han Peixun Liu Hang Yang Huiyuan Luo Jiajia Wu |
| author_facet | Qingqing Li Guangliang Han Peixun Liu Hang Yang Huiyuan Luo Jiajia Wu |
| author_sort | Qingqing Li |
| collection | DOAJ |
| description | It is difficult to find correct correspondences for infrared and visible image registration because of different imaging principles. Traditional registration methods based on the point feature require designing the complicated feature descriptor and eliminate mismatched points, which results in unsatisfactory precision and much calculation time. To tackle these problems, this paper presents an artful method based on constrained point features to align infrared and visible images. The proposed method principally contains three steps. First, constrained point features are extracted by employing an object detection algorithm, which avoids constructing the complex feature descriptor and introduces the senior semantic information to improve the registration accuracy. Then, the left value rule (LV-rule) is designed to match constrained points strictly without the deletion of mismatched and redundant points. Finally, the affine transformation matrix is calculated according to matched point pairs. Moreover, this paper presents an evaluation method to automatically estimate registration accuracy. The proposed method is tested on a public dataset. Among all tested infrared-visible image pairs, registration results demonstrate that the proposed framework outperforms five state-of-the-art registration algorithms in terms of accuracy, speed, and robustness. |
| first_indexed | 2024-03-09T05:07:20Z |
| format | Article |
| id | doaj.art-c4df526bd39b4a1f929d23584c2699b8 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T05:07:20Z |
| publishDate | 2021-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-c4df526bd39b4a1f929d23584c2699b82023-12-03T12:53:23ZengMDPI AGSensors1424-82202021-02-01214118810.3390/s21041188An Infrared-Visible Image Registration Method Based on the Constrained Point FeatureQingqing Li0Guangliang Han1Peixun Liu2Hang Yang3Huiyuan Luo4Jiajia Wu5Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaIt is difficult to find correct correspondences for infrared and visible image registration because of different imaging principles. Traditional registration methods based on the point feature require designing the complicated feature descriptor and eliminate mismatched points, which results in unsatisfactory precision and much calculation time. To tackle these problems, this paper presents an artful method based on constrained point features to align infrared and visible images. The proposed method principally contains three steps. First, constrained point features are extracted by employing an object detection algorithm, which avoids constructing the complex feature descriptor and introduces the senior semantic information to improve the registration accuracy. Then, the left value rule (LV-rule) is designed to match constrained points strictly without the deletion of mismatched and redundant points. Finally, the affine transformation matrix is calculated according to matched point pairs. Moreover, this paper presents an evaluation method to automatically estimate registration accuracy. The proposed method is tested on a public dataset. Among all tested infrared-visible image pairs, registration results demonstrate that the proposed framework outperforms five state-of-the-art registration algorithms in terms of accuracy, speed, and robustness.https://www.mdpi.com/1424-8220/21/4/1188infrared-visible registrationobject detectionconstrained pointsLV-ruleevaluation method |
| spellingShingle | Qingqing Li Guangliang Han Peixun Liu Hang Yang Huiyuan Luo Jiajia Wu An Infrared-Visible Image Registration Method Based on the Constrained Point Feature Sensors infrared-visible registration object detection constrained points LV-rule evaluation method |
| title | An Infrared-Visible Image Registration Method Based on the Constrained Point Feature |
| title_full | An Infrared-Visible Image Registration Method Based on the Constrained Point Feature |
| title_fullStr | An Infrared-Visible Image Registration Method Based on the Constrained Point Feature |
| title_full_unstemmed | An Infrared-Visible Image Registration Method Based on the Constrained Point Feature |
| title_short | An Infrared-Visible Image Registration Method Based on the Constrained Point Feature |
| title_sort | infrared visible image registration method based on the constrained point feature |
| topic | infrared-visible registration object detection constrained points LV-rule evaluation method |
| url | https://www.mdpi.com/1424-8220/21/4/1188 |
| work_keys_str_mv | AT qingqingli aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT guanglianghan aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT peixunliu aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT hangyang aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT huiyuanluo aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT jiajiawu aninfraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT qingqingli infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT guanglianghan infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT peixunliu infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT hangyang infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT huiyuanluo infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature AT jiajiawu infraredvisibleimageregistrationmethodbasedontheconstrainedpointfeature |