Registration method for infrared and visible image of sea surface vessels based on contour feature

In this paper, a modified infrared and visible image registration method based on contour feature is proposed. Our method firstly extracts the feature contour and eliminates sparkling waves contour of the sea surface, determines the main direction of the contour based on the contour image, then uses...

Full description

Bibliographic Details
Main Authors: Yakui Dong, Cheng Fei, Guopeng Zhao, Lili Wang, Yunxia Liu, Junliang Liu, Shuzhen Fan, Yongfu Li, Xian Zhao
Format: Article
Language:English
Published: Elsevier 2023-03-01
Series:Heliyon
Online Access:http://www.sciencedirect.com/science/article/pii/S2405844023013737
_version_ 1827972634003898368
author Yakui Dong
Cheng Fei
Guopeng Zhao
Lili Wang
Yunxia Liu
Junliang Liu
Shuzhen Fan
Yongfu Li
Xian Zhao
author_facet Yakui Dong
Cheng Fei
Guopeng Zhao
Lili Wang
Yunxia Liu
Junliang Liu
Shuzhen Fan
Yongfu Li
Xian Zhao
author_sort Yakui Dong
collection DOAJ
description In this paper, a modified infrared and visible image registration method based on contour feature is proposed. Our method firstly extracts the feature contour and eliminates sparkling waves contour of the sea surface, determines the main direction of the contour based on the contour image, then uses the improved Scale Invariant Feature Transform (SIFT) method as the feature point to construct the descriptor, completes the registration of the two images. 30 sets of infrared and visible-band vessels images were selected for registration experiments. Compared with previous reports, the experimental results showed that the proportion of effective feature points detected by this method can reach 70%, and the average number of effective feature points detected by proposed method can reach 196 in visible band image and 279 in infrared image. The running time was 5.3599s, shortened by 25% compared with previous reports, and the average Root Mean Square Error (RMSE) value was 2.3566, smaller by 75% compared with previous reports. An effective registration method is provided, which can be used for infrared and visible image processing and comprehensive utilization of information in marine scenes.
first_indexed 2024-04-09T19:24:48Z
format Article
id doaj.art-b3acde1026404f1b9fba66310f85fbb1
institution Directory Open Access Journal
issn 2405-8440
language English
last_indexed 2024-04-09T19:24:48Z
publishDate 2023-03-01
publisher Elsevier
record_format Article
series Heliyon
spelling doaj.art-b3acde1026404f1b9fba66310f85fbb12023-04-05T08:21:05ZengElsevierHeliyon2405-84402023-03-0193e14166Registration method for infrared and visible image of sea surface vessels based on contour featureYakui Dong0Cheng Fei1Guopeng Zhao2Lili Wang3Yunxia Liu4Junliang Liu5Shuzhen Fan6Yongfu Li7Xian Zhao8Key Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, China; Corresponding author. Center for Optics Research and Engineering, Shandong University, 266237, China.Key Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, China; Corresponding author. Center for Optics Research and Engineering, Shandong University, 266237, China.Key Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaKey Laboratory of Laser & Infrared System, Ministry of Education, Shandong University, Qingdao, China; Center for Optics Research and Engineering, Shandong University, Qingdao, ChinaIn this paper, a modified infrared and visible image registration method based on contour feature is proposed. Our method firstly extracts the feature contour and eliminates sparkling waves contour of the sea surface, determines the main direction of the contour based on the contour image, then uses the improved Scale Invariant Feature Transform (SIFT) method as the feature point to construct the descriptor, completes the registration of the two images. 30 sets of infrared and visible-band vessels images were selected for registration experiments. Compared with previous reports, the experimental results showed that the proportion of effective feature points detected by this method can reach 70%, and the average number of effective feature points detected by proposed method can reach 196 in visible band image and 279 in infrared image. The running time was 5.3599s, shortened by 25% compared with previous reports, and the average Root Mean Square Error (RMSE) value was 2.3566, smaller by 75% compared with previous reports. An effective registration method is provided, which can be used for infrared and visible image processing and comprehensive utilization of information in marine scenes.http://www.sciencedirect.com/science/article/pii/S2405844023013737
spellingShingle Yakui Dong
Cheng Fei
Guopeng Zhao
Lili Wang
Yunxia Liu
Junliang Liu
Shuzhen Fan
Yongfu Li
Xian Zhao
Registration method for infrared and visible image of sea surface vessels based on contour feature
Heliyon
title Registration method for infrared and visible image of sea surface vessels based on contour feature
title_full Registration method for infrared and visible image of sea surface vessels based on contour feature
title_fullStr Registration method for infrared and visible image of sea surface vessels based on contour feature
title_full_unstemmed Registration method for infrared and visible image of sea surface vessels based on contour feature
title_short Registration method for infrared and visible image of sea surface vessels based on contour feature
title_sort registration method for infrared and visible image of sea surface vessels based on contour feature
url http://www.sciencedirect.com/science/article/pii/S2405844023013737
work_keys_str_mv AT yakuidong registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT chengfei registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT guopengzhao registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT liliwang registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT yunxialiu registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT junliangliu registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT shuzhenfan registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT yongfuli registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature
AT xianzhao registrationmethodforinfraredandvisibleimageofseasurfacevesselsbasedoncontourfeature