Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss
Infrared (IR) and visible image fusion has become an important technology for maritime environment awareness. In this study, we employed refined features fusion and Sobel loss for maritime IR and visible image fusion. First, we used the encoder in Densefuse net to transform the image to be fused fro...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-08-01
|
| Series: | Photonics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2304-6732/9/8/566 |
| _version_ | 1797408327934672896 |
|---|---|
| author | Zongjiang Gao Feixiang Zhu Haili Chen Baoshan Ma |
| author_facet | Zongjiang Gao Feixiang Zhu Haili Chen Baoshan Ma |
| author_sort | Zongjiang Gao |
| collection | DOAJ |
| description | Infrared (IR) and visible image fusion has become an important technology for maritime environment awareness. In this study, we employed refined features fusion and Sobel loss for maritime IR and visible image fusion. First, we used the encoder in Densefuse net to transform the image to be fused from the pixel domain to the feature domain. Then, the features’ information was accurately measured, and the refined features were fused and sent to the decoder to reconstruct the fused images. Mixed loss, commonly employed in image fusion, eliminates the effect of different losses but also introduces hyperparameters. We innovatively used Sobel loss to measure the input and fused images to reduce the hyperparameters in the loss function. Finally, experiments were performed, and our algorithm achieved good fusion results in the qualitative and quantitative evaluations. |
| first_indexed | 2024-03-09T03:57:50Z |
| format | Article |
| id | doaj.art-bd04e76ee3c2429da35130ef95c47a8e |
| institution | Directory Open Access Journal |
| issn | 2304-6732 |
| language | English |
| last_indexed | 2024-03-09T03:57:50Z |
| publishDate | 2022-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Photonics |
| spelling | doaj.art-bd04e76ee3c2429da35130ef95c47a8e2023-12-03T14:18:49ZengMDPI AGPhotonics2304-67322022-08-019856610.3390/photonics9080566Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel LossZongjiang Gao0Feixiang Zhu1Haili Chen2Baoshan Ma3Navigation College, Dalian Maritime University, Dalian 116026, ChinaNavigation College, Dalian Maritime University, Dalian 116026, ChinaNavigation College, Dalian Maritime University, Dalian 116026, ChinaSchool of Information Science and Technology, Dalian Maritime University, Dalian 116026, ChinaInfrared (IR) and visible image fusion has become an important technology for maritime environment awareness. In this study, we employed refined features fusion and Sobel loss for maritime IR and visible image fusion. First, we used the encoder in Densefuse net to transform the image to be fused from the pixel domain to the feature domain. Then, the features’ information was accurately measured, and the refined features were fused and sent to the decoder to reconstruct the fused images. Mixed loss, commonly employed in image fusion, eliminates the effect of different losses but also introduces hyperparameters. We innovatively used Sobel loss to measure the input and fused images to reduce the hyperparameters in the loss function. Finally, experiments were performed, and our algorithm achieved good fusion results in the qualitative and quantitative evaluations.https://www.mdpi.com/2304-6732/9/8/566maritime imageinfrared and visible image fusionfeature fusionSobel loss |
| spellingShingle | Zongjiang Gao Feixiang Zhu Haili Chen Baoshan Ma Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss Photonics maritime image infrared and visible image fusion feature fusion Sobel loss |
| title | Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss |
| title_full | Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss |
| title_fullStr | Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss |
| title_full_unstemmed | Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss |
| title_short | Maritime Infrared and Visible Image Fusion Based on Refined Features Fusion and Sobel Loss |
| title_sort | maritime infrared and visible image fusion based on refined features fusion and sobel loss |
| topic | maritime image infrared and visible image fusion feature fusion Sobel loss |
| url | https://www.mdpi.com/2304-6732/9/8/566 |
| work_keys_str_mv | AT zongjianggao maritimeinfraredandvisibleimagefusionbasedonrefinedfeaturesfusionandsobelloss AT feixiangzhu maritimeinfraredandvisibleimagefusionbasedonrefinedfeaturesfusionandsobelloss AT hailichen maritimeinfraredandvisibleimagefusionbasedonrefinedfeaturesfusionandsobelloss AT baoshanma maritimeinfraredandvisibleimagefusionbasedonrefinedfeaturesfusionandsobelloss |